Hearthfire seems to be severely impacting my performance in Skyrim. How about the rest of the pc users?

I haven't noticed any difference.

I have noticed some intermittent pauses - every minute or so the game hangs for a second or two. I am also finding loading between areas is taking longer, and my save files have balooned in size from about 11-12 mb to 50-56 mb post hearthfire. This is causing about a 15 second freeze when I hit F5.

I am looking into whether there is something going on with my mods, but I have not installed any new ones lately, and this only started happening after Hearthfire was installed. Odd thing is, if I untick the HearthFires.esm the problems still occur...

What sort of performance issues are you having?