I have a fetish for unarmed characters so I was happy when I heard SkyRe addressed the issue of the lack of unarmed skill trees. It's not present in the "Lighthanded/One Handed weapons" section, and the first possible perk is armsman, which supposedly increases my damage with one handed weapons by 20% percent, but my unarmed damage went from 23 to 20. Is something wrong?

Well, since T3nd0, the author of SkyRe, does not frequent these forums, asking here probably won't get you too far. I suggest posting in his Bugs thread on nexus, he usually catches those, even if he doesn't respond. I personally don't use Unarmed much, so I'm afraid I can't help you. But if I were you I'd try and see if I could consistently reproduce the bug.