Ah, I see. Well, for the sake of clarity, here are some more pictures.
The connector piece has two tabs that lock into rails on the housing. Twisting it a few degrees may help, but I just use brute force and push it out (into the housing). It takes a good bit of force, but not too difficult.