I just sold my E46 325i (premium and sport packages) last month. I used it as a spare car; mostly for hauling people around and for long work trips up and down thru California. My younger son is studying in Europe this year so I have his E53 X5 as a spare car and didn't need the E46 anymore.
The E46 was probably the best sedan in the world for its time but its still a sedan, not a sports car. The Boxster is much more fun to drive. I'd take a Boxster every day over the BMW.