What choices exactly are missing? I mean, yeah, more weapons and armor would be nice. There are mods available for that, as far as the PC users go, but even vanilla Skyrim has a fair number of choices.
Locks for one. Make several way to access them
Bash - noisy(Detection by NPCs), possibility of destroying items inside.
Pick - silent, depends on lockpick ability
Spell - In between silent and noisy. Depends on alteration ability.
Different weapons have different playstyles.
You can keep enemies at length with spears. Get in close with daggers. Trade blows with S&S. Try to overcome defenses with 2Handers. Fire more rapidly with bows, or fire with force with crossbows. Darts/Throwing weapons require no maintenance and are fairly silent.
Levitation was always a rather magicka intensive spell and doesn't last forever(Levitating gods were a result of gaming the alchemy/enchant system). It was abusive in morrowind because the combat ai was terrible. So now that the combat ai can handle it, it's removed. Why not work on it instead of scrapping it altogether?
Spellmaking allows you to combine parts of spells you'd like to use instead of casting the base spell every single time.