You need to keep the panel or remove entire set up as the h/u and amp are dependent on it being there. That said, there is plenty of room in the center console so you could just bury it in there and leave it permanently set to the most (of the choices) desirable sound setting. You might be able to eliminate it completely if you replaced your amp w/ one from a M490 set up (I have a spare 4x40 one if you are interested) and possibly switch a few wires around. See the sound system schematic for details.
Good luck
