As of late, I've started to use light armor a bit more. Mainly Savior's Hide, though. Speed has gained importance in my mind.
In previous TES games I'd always use heavy armor, and in Skyrim its still my favourite. I generally wear Ebony Armor, except on my Orcs, they wear Orcish.
Now, as to weapons: my very-favourite weapon in Skyrim so far(pre Dragonborn DLC) is Mehrunes' Razor. (bit of a leftover fancy from Oblivion's DLC.
But, of course, this doesn't really fit with heavy armor, in that I like the Ebony Battleaxe the best.
I find all daedric/dragonbone weapons very ugly, with the exception of the Dragonbone Greatsword probably.
As for bows, I prefer longbows over crossbows, and my favourite is Zephyr(Dawnguard)