It's the lack of major and minor skills. In the past, you could just not pick your most used skills as major/minor skills to help control leveling. In Skyrim, every skill counts towards the next level.
It may help to avoid any of the crafting skills.
What guardian stone did your character pick? The warrior, mage, thief and lover stones all speed up skill leveling as well.