[clickman]

I would have said ground loop too, but the OP says it takes a while to appear. Ground loop would be there all the time.

These units act funny sometimes when the connections between the faceplate and the main body aren't clean.

It's easy to do, so it's worth a try to carefully clean the bank of contacts with alcohol.