Finally start playing and what do I get? Particles following me out of Fort Sunguard, those dirt particles that fall from the ceiling, and a bunch of dust motes, all continuously following me around outside, wherever I go.

Iis your character named Pigpen? http://en.wikipedia.org/wiki/Pig-Pen

I had that happen to me with water drops falling from a cave. I didn't notice at first due to the fact that it was raining when I exited the cave. When the sun came out I noticed wherever I went there was water falling on me. I loaded up saves from right before entering the cave and could recreate the problem every time by walking under dripping water in a particular part of the cave. I think I was about to just skip the cave altogether when I noticed that they would disappear after fast traveling several times. I think I needed to fast travel far away from the cell the cave was in. Sorry I can't offer more help, it was back in early December.

The droplets remain until you go through certain areas in which have some activators that make them disapper. Saving, reloading, going to other cells won't help. I'm surprised more people didn't notice this.