My issue is stated in the title.

I have All the DLCs, and all of their corresponding unofficial patches, as well as the unofficial Skyrim patch.
I also use UFO. (And therein probably lies my problem)

It is quite annoying, as I cannot complete a certain Dawnguard quest so long as I still have a follower attached.

Punch him until he dismisses himself.