Bandits. I've never understood why, no matter where you go or what you're doing, if any group of bandits sees you, they will try to kill you. It doesn't make a whole lot of sense.
I understand that most bandits would attack you for your money, weapons etc., but I think there would also be many that would just want to leave you well alone and go about their business of trying to survive.
I think it would be a lot more interesting and immersive if there were groups of bandits that will attack you on sight, and others that will not attack you unless you come too close or you attack them first.

Here's an idea I have for how this could work.

Say you have a bandit camp such as Halted Stream Camp or White River Watch. When you walk past, the bandits that can see you, do not attack. When you approach the camp, there may be a couple of guards stationed at the entrance, who stop you as you approach, and ask what your business is.

This could work a lot like the "Thief" encounter, where you have several responses that lead to different outcomes. You could have a positive, neutral or negative response.

Positive: Perhaps the options for this could be something like, asking if you can join that group of bandits.This would be fun, you could have missions to raid travelling merchants, or raid rival bandit camps for example. You could move up the ranks to become the Chief of that group.
Or the bandits could have a similar system to Stewards and barmen, where you ask for work and they give you gold to kill a bandit leader, giant, etc.

Neutral: I can't think of much for this one, perhaps you could have an option to say that you accidentally stumbled upon their camp, and bribe them to leave you alone, or if you have a high Speechcraft, persuade or intimidate them into letting you pass (for whatever reason).

Negative: Pretty much, just a response to let them know that you're about to slaughter them all, and it's business as usual

What are your thoughts on this system? Could it be implemented in future TES games?