if you have 100 points in any skill like say single handed weapons, you will do less damage then a nooby with 20 points but 1 perk in the 25% boost in damage.
In fact, have 100 points and being a master only gives you 24% boost in damage.
I truly think that's why this game is somewhat broken with balance. Perks should be compliments to the skill tree, and increasing skill should be really what determines your character.

No wonder my shield bashes do more damage than I can do with my Daedric Mace. Been playing a bit of a mage with heavy armor and I put 0 perks into one-handed so far but a lot into block.