So I went against my gut feeling and spam leveled smithing to get daedric armor. Honestly, for me it's taken a bit of joy out of the game. I always dislike crafting in any game I play, including other ES games, so I'm not sure why I thought this would be any different. I prefer to use found gear, it's more fun and rewarding for my play style.
To get my perks back, I'm considering using the console and then dumping my daedric armor for something more suitable for my level (22). Some light googling revealed the procedure for removing perks using the console, I just wonder if anybody had any personal experience "fixing" their perks in this way.
Thanks!