Don't use followers then?
Sometimes they follow you anyways, like the guy that wants to go to fix the problem with the tree. He svcks awesome!
But chosen mates, it's not like you know they will svck or not. Not until you played them through a few times. So me on "first" time trying followers, only to be dissapointed...or rather DEAD!
Well, I made my choice...I was a little bit unhappy with my char, I leave Alchemy, Smithing and Enchant alone this time...sort of. A little bit here and there won't kill any char, but no more 5 lvl-gaining from Alchemy alone.
I will be another sneaky Archer, with some elemental friends.....I just like to play it this way and this time I play it on highest level.

I will die sooo many times, but maybe the hardest difficulty actually can make me to play the game?