I wouldn't remove it. You'll lose rigidity, safety, and seat belts. Even if you don't roll over, it will be very helpful if you get broadsided. The hardtop adds no structural support, so in a crash it will do you no good.
Even if you head is above the roll bar, if you flip your head will get pushed down toward the steering wheel wheel, so the bar will offer more protection than no bar. You can do what you want, but I wouldn't risk dying or serious injury just because you think the bar is useless.