It's the game's way of teaching you not to be a kleptomaniac.
...until you have a house.

And it's kind of a shame... there IS a "carry more" perk. And it's buried in the perk tree for Pickpocketing, a skill I've almost never used in Morrowind, Obivion, or either Fallout.
