Replace you old mounting rubber to better isolate your fuel pump. Overtime the rubber deteriorates and will cause the pump to vibrate and make noise. Also if replacing your fuel pump always use a new mounting rubber

Austin Healey Sprite, MGB 1962 to 1974.5, MG Midget to 1974