Well, I find the perk system more complex and meaningful than few attributes, as well as being more personal.
I like the idea of perks, but hate how they've been implemented in Skyrim. It just feels like they're there to simplify the skill system and speed up progression rather than add complexity to the game. Also, I don't understand why people keep comparing them to attributes like they're some kind of substitute. They're not. Perks are skill related and don't have much involvement in defining who your character is physically and mentally (which is what attributes should be there to do).
It's also more limited, so my character can't become god-king of every skill, filling EVERY role. He only fills a single role, which his perks define.
I wouldn't call it limited really.

We get around 80 perk points, which isn't enough to pick everything... but it's still more than enough to become godlike in a lot of skills. In fact, on my first character (melee) I was able to max out all of the perk trees for all of the skills I was interested in by level 40. If I made another melee character, i'd most likely end up completing the same trees in no time at all.
Not to mention that there are many things that RPGs generally use that have been added in Skyrim (duel-wielding, marriage, radiant quests, long-ass dungeons, more difficult encounters, less enemy-scaling, less armor-scaling, etc.). Now, you ARE encouraged to go artifact or armor hunting, because every item with an enchant isn't scaled, unlike Oblivion. So, if you have the urge to deal with some punishment and get yourself Rahgot's mask and staff, you can do it, and be stronger for your accomplishment.
- Dual wielding is good, but in a combat system that relies a lot on player skill and not just the character's abilities, I wouldn't consider this something that makes the game "more of an RPG"
- Marriage feels like a shallow feature tacked onto the game last minute
- "Radiant" aka generic fetch/kill quests don't make the game a better RPG, or even a better game. In fact, most of Skyrim's questlines seem incredibly lacking and rushed... and no amount of radiant quests can excuse this
- "Long-ass dungeons" ... what? Most of the dungeons seem very short and incredibly linear to me.
- Level-scaling - ok, i'll give you this one. Level-scaling is definitely improved over Oblivion... but it's still present. Shop inventories are still scaled to the player-character's level, and a lot of the loot is still scaled also