So, I recall the first time I played Skyrim, for some strange reason i decided to go Hand To Hand despite there not being a skill tree for it. I knew there was a HTH glove in Riften from reading a wiki, I knew Kajhit had bonus HtH damage, so I made a Kajhit and headed for Riften.
Surprisingly, this served me rather well, and with other bonuses I found I was doing lots of HtH damage well into the higher mid levels. Ah, good times.
Point is, I love HtH even though it was not supported. And I was wondering if you wanted it or not.