Have you put any points into health at all? It is unusual to be 1 hit by a regular bandit.
Ethereal shout can be handy in a tight spot because they can't harm you while it is active while you can stiill hurt them with spells.Edit: text was a little small for some reason. 
I haven't put any points in health, its all been doing to Magicka for the last thirty levels. I'll have to look into this Ethereal Shout. Is it locked within a quest/plot line or can you find it by way of exploration?
Edit: Is this ill-advised, should I focus on health more?
Don't get hit? If you're at a point where you're struggling, summon something via conjuration and then hide via illusion.
The problem is two-fold. I can't avoid everything, this is a simple fact. I'm going to be in a cave with tight corridors that have enemies sneak up on me. The solution to that problem (or similar circumstances) is an excessive amount of micro-management through tedious menus. As noted in the original post, I'm utilizing pets and illusion spells to my advantage. But preemptively juggling ebonyflesh, invisibility, detect life, rout, pacify, storm atronach, fireball and healing magic every thirty seconds is a bit much.
Thank you for the response, but I'm looking for things more in the way of passive buffs, shouts, enchant suggestions, potions, etc..