JAAY: In the past - and maybe future again - I was really in to the motorcycle ride. Three times I gave up my ride for the family/wife. I was fortunate enough to have a wife that understood I needed by recreational time and for me that meant a good ride with the tunes blaring away in my helmet (note: this did not mean I couldn't hear the road or pay attention to my surroundings). Each time I gave it up it was a tough decision, but family needs were always, and always will be, more important. The reason I have the Boxster today is because my wife still knows I need something besides work and family. I need some time alone enjoying the ride.
If you decide to give it up, do so with the understanding with your wife that someday - when the need really hits you - you will be getting another ride. Be it with two wheels, four wheels, or wings instead of wheels (I'd really like to fly!) so she'll be there to support your choice & needs. Just as you do with hers.