The one thing that truly drives me crazy, though, is that if I want to play a specialized character (say, a barbarian), my maximum level will be low. I realize that I can just train other skills, and only put perks in to the skills that define the character, but that is a pretty roundabout way of doing things. Not to mention, it can be game-breaking from a role-playing prespective. I just want to play a Two-handed weapon-wielding, light armor-wearing, rampaging barbarian without having to worry about raising heavy armor, or magic skills, or whatever. Same thing can be said for a Mage, or a thief. It just feels too limited.
Forgot to add, the only reason I want to be at least semi-high level is to fight a broader array of tough enemies.