"raw power"...huh? Power of what? CPU, RAM, GPU, HDD? And why are the voices of the NPC's in Oblivion, FO3 and FNV ok then?
Sorry, I mean RAM. This game is less hardware stressing than previous ones, but the RAM usage can go to the rof easilly. That's what I suggest you to exit all the unneded programs you can, that could help and if not at least you will know that the RAM is not the problem.
By the way, I didn't mean you haven't enough physical RAM installed I have only 250 Mb more than you and have no problems at all, so 3 Gb should be enough while you didn't have too many processes in the background.