Well, Mods will fix this but since you don`t have that choice just just carry on. They eventually `teleport` to you while you are not looking.
If you appear to lose them quickly enter a cave or house and they`ll appear.
Another option is to carefully choose where you run, avoiding any rocks or such that might block the Follower`s AI pathing. But it means you`ll be going the long way around a lot of things, especially mountains.