I was assuming that cloth armor would still have useful stats, like mage robes/hood and it would be less stamina restrictive. I was also assuming it could be enchanted, but I could be wrong on some of that stuff.
Mage robes are enchanted with useful stats, the Archmage robes being the best in the game along with the necklace your given, and a circlet. The circlet is best obtained at about level 25/30, and it will be something like 70 to magick which you cannot beat. I like the cultists robes, because I can enchant them with 1 enchantment, for there is already one on them, but the gloves and boots have none so I can put 2 enchantments on them. There are also black nd blue robes that have no enchantments on them. But as I said, the Archmage robes are the best.
I use sneak, for my sorceress is very sneaky, and I also use 1-handed for the bound sword and some archery for the bound bow. I play at adept, level 44/45 and have few problems. I use sneak, 1-handed, archery, destruction, conjuration, illusion, a little restoration, alchemy and enchanting.