You can't apparently get enough perk points to master a single discipline (Combat/Magic/Stealth) so you suffer hugely trying to be a jack of all trades losing unique abilities and actual bonuses to a area.
So many perks are things that should have been given to you for reaching certain levels of a skill (Look at me I'm a master bowman but don't ask me to do any trick shots, crit or do more base damage per shot then a novice) and have been previously because at least it made sense, you practice and achieve a high level of skill you should be better off, be more efficient and skilled then a novice of the area. I guess though they got confused between skill and perks/talents. I'd like a perk system where you get certain gifts or need to be trained to do something special but 5 ranks of increased damaged you need to take to get to that, just no. At least in fallout you could get about 50% if not more of the perks and avoid most of the ones you didn't want short on a select couple to get that unique talent.