Mike makes a good point, but here's a thought...

The purpose of removing the ground is to open a ground loop - by definition that means there is another path to ground already connected.

Now, that is all very well while said alternative path is still connected, electrical safety shouldn't be an issue as there is still an intact ground connection, BUT, as soon as you disconnect the equipment that is providing the alternative ground connection THEN you may be at risk.

Thus, from a safety perspective, my preferred advice would be a ground lift in the audio signal path, NOT the mains. If I was the only user and I could guarantee that no one else could possibly come into contact with anything I might consider lifting a mains earth, but I would make damn sure that the audio gear that is providing the alternate ground stayed connected.

--=-- My credo: If it's worth doing, it's worth overdoing - just ask my missus, she'll tell ya laugh --=--
You're only paranoid if you're wrong!