I'm just curious if anyone here knows how this mechanic works and what determines that they will actually follow you. I've just had a couple of bandits stand right next to the exit door but they refuse to set foot outside, while in another bandit fort close to Whiterun they were very eager to chase me all the way.