Reloading old saves doesn't fix it - it seems to effect everything once it crops up. I uninstalled and reinstalled the game, which fixed it temporarily, but then it showed up again after about 10 hours of play-time.
For reference, I have Dawnguard installed.