Thanks for the help folks. I did a little nosing around after the comments.
Firstly I thought, it's an amp, it's all about power, how could it
not have a ground? How wrong I was.

There are the little concentric squares, clear as day near the top. Then here's the posh Isotek 6-way. Not homemade or cheap...

It clearly says it must be earthed - but I've never done anything with the Ground on the left. I get around +/- 2V DC (reading flicks around) between that Ground and the radiator but if I switch to AC on the multimeter it suddenly reads about 20V and then quickly drops to stabilise around 4V.
I'm surprised that the Isotek says it must be earthed, I would've thought that plugging it in would automatically earth it through the plug. But then if there was some potential on the earth...
So... should I always have linked that green Ground to the radiator (or some other true ground)? The brief manual doesn't explicitly say to. If the Isotek wasn't properly grounded, would you expect some potential on it?
Lectrician, when you said extensions, what did you mean? Sorry haven't had the stones to play with the mains yet, I'll take a look tomorrow!