That's what I'm doing.

That's wat I'm using too. No armor, only enchanted robe. Die quick if get hit but fun

I was thinking about a melee character focused on two handers but can allteration keep up with heavy armor, how competetive are flesh spells with mage armor perk vs fully upgraded daedric stuff?

Heavy unenchanted dragon armor got 280 something armor rating, and almost 700 if you pick the perks in the heavy armor tree.

I would think so but Ive gone with a Ancient Nord helmet, Dragonscale armor, daedric gauntlets, Dragonplate boots and a Dragonplate shield. Mostly enchanted with spell cost reductions and magicka regens.

Yes I use a shield while casting spells

I'm at level 13 and still wearing the Novice Robes from the Helgen Keep.

On my next playthrough I will be a robes-only mage. The robes in the game look absolutely stunning, they look intelligent, but at the same time hardy and worthy of a long journey.