Honestly, the game is terribly optimized for PC. Certain people have great performance, while others with computers that should be able to run it on the same level are stuck with 25fps in small settlements like Riverwood. The GPU manufacturers need to come out with new drivers like they did for BF3, and Bethesda needs to patch it.
Though your machine is on the low-end, many others are having terrible performance problems.
The official minimum is total and complete nonsense. It's totally meaningless. Here's a "practical" reference, although it needs plenty of adjustment now that the game is loose in the world:
what i would do in your shoes is start with OCing your CPU slightly. even at 3Ghz all my cores are being utliized over 50% (quadcore) your ram is fine. although your graphics is not crash hot.
although i hate when games post min requirements they are soooo misleading and personally i think min requirements should be recommended specs becuase quite frankly for skyrim atleast the min specs werent tested. i dont see how a 2.0Ghz dual core CPU could run skyrim. a quad 2.0 might on the other hand.