Push comes to shove... force "open" that passage and make it happen. Purchase a "plug" for the larger hole. No?
I ran into the same problem when replacing my wheel and, when I hit that "no-go" zone quickly recognized the situation I'd be in, and opted for a narrower tool. I forget whicdh one.
Keep us posted!! Good luck.