I have my shield in my left hand and my sword in my right. I have destruction magic spells hot keyed to my right hand but when I press the hotkey it unequips my shield in my left and now I have my sword in my right hand and my spell in my left hand.

I want to keep my shield up at all times but the game wont let me, am I doing something wrong?