1) Put the amplifier in a separate metallic box from the power supply
2) Modify the power supply and add a choke between the capacitors like this: trafo->rectifier>capacitor>choke>capacitor
3) Try the amplifier on batteries to see if you still have the problem --> maybe the input signal is not good