Problem digitizing vinyl audio

[Xoanon]

I just tried making a recording from a a couple of different vinyl records with a brand new stylus in Audacity and every few seconds the stereo image will suddenly alternate between (and it's hard to explain) jumping the panning from left to right and vice versa. It's not a hard pan (the other channel does not go silent) but the audio seems to suddenly move from the center to somewhere in the left to suddenly somewhere in the right with a loud click at these points (a digital click, not a vinyl click). I am recording into a Xonar U7.

You can hear it in this sample file - this is the raw audio; I have simply faded it in and out at each end. Check out the sudden shift in imaging around 8 seconds in and again at 12 seconds. What is causing this and how do I stop it? I tried centering the phase in Audition but it doesn't help.

Thanks to anyone who might be able to help.