Way to stop characters from shifting when shadow is removed?

I want to remove the shadow from a bunch of cropped characters in side right perspective. When I remove the shadow, the character shifts to the left quite a bit.

Oddly, this only seems to affect characters in side right perspective.

Is there a way for me to remove the shadow that won't cause the character to shift like this?

4 Replies