Looks like you've got a lot of good defense there. Do you plan on using a lot of smithing and enchanting to fairly super-charge your weapon? It's fairly easy to get armor to the armor cap, especially if you've got those Heavy Armor perks, so all those perks leading up to Daedric Smithing will really only be for your weapon.
In addition, if you're willing to enchant your armor to fortify your chosen magic schools, you could likely cut back on a lot of the spell-mastery perks.
Also, consider investing 4 points in Restoration for Recovery (+50% automatic magicka regen) and Avoid Death (automatic instant heal when you drop too low on health).
Yeah, I thought I went kinda overboard on defense.

I was planning on setting up a enchanted and smithed up weapon, yes. I can consider cutting out Heavy Armor, because I really only wanted Conditioned.
I wasn't planning on getting the 100% reduction in magic schools, makes the game a bit boring IMO, so I want to keep the mastery perks.
As for Resto, that sounds wonderful. Thanks for the input.