That's why this sort of camera mapping is better done with actual geometry, like chamfered half-dome, or even one that maps the sphere into more exact shape, in this case a rectangular room.
But it will always look like trick, this will never work 100perc :- )