I noticed I was accepted by The Legion and when I tried to pickpocket their chief I failed and everyone started attacking me. So I reloaded my last save and it said I was vilified, which wasn't the case because when I saved the game I was accepted by them. I'm thinking this is why so many people are complaining about getting attacked when they did nothing for it to occur and this is a major bug that I hope is fixed.