This happened to me on my male nord sword and shield playthrough also but I continued until I found out my deflect arrow perk didnt work and started again, now its my 2 handed male nord and it is only noticable during power attacks.