The disconnect between what you're seeing and what your inner ear is feeling is the issue. It's a hard thing to overcome, but it is true that the more you experience it the more you will get used to it.
I don't think some understand the degree to which your brain ties the two sensory inputs together. Every micro movement of your head, turning it slightly, adjusting it up and down while viewing the top and bottom of your screen, or scanning side to side, is tied to what your eyes are doing. When you separate the two, it's akin to someone removing an appendage - it is literally that strong of a sensation.