Here, I fixed it for you: The Pathing AI.
Why can't your follower step up 4 inches, or jump down where you jumped down?
When running through the wilderness or climbing a mountain, I constantly have to go back and try to coach Lydia over some bumps. Either that, or let her run around the entire mountain complext before I see her again.