Ok so it seems almost every time I start a mission and fast travel my follower is no where to be found. So I have to either go back to my house or where I found the follower and pick them up again. Its really annoying.