But my problem on Skyrim right now is that. Mostly everytime someone hits me, I have half of my health gone?

Is it my Armor? Cause I have been playing on Apprentice. Switching Over to novice. And then 25% Of my health goes away.. And it's Bandits.

I've been playing Dawnguard. But I doubt that's the problem.
EDIT: My armor is really good to, 60 Armor rating Light armor just the base of it