That is not normal operation. The side view mirrors do not operate with the key out of the ignition, or ignition off. When you energize the mirror heaters, they will stay on for 12 min. and then go off, but again only with the ignition ON.
Sounds like a new starter (ignition) switch could be in your near future.