When I assign numbers to a weapon it automatically assigns it to the right hand. Holding shift and pressing a number doesn't seem to work.

A weapon will always go to your right hand.Spells will go to either one unless you have a weapon and a spell.

Favorite it first then click on it after pressing Q and then click a number.