Is it the same in Skyrim?
After buying Vigilance it took me all of 10 minutes to get pissed off with his constant barking, so I told him to stay at Breezehome. Fully intending to go back to get him and take him on an adventure, I've just realised that that was a couple of days ago (real-time) and, while he stayed in the house for a while, I haven't seen him since. He's also not at Riften. I've been wandering around Skyrim for a couple of months now, so I would guess there have been a couple of weeks since I left the mutt to his own devices (next to a cozy fire inside a dry house with food everywhere... the ungrateful whelp). Am I ever going to see him again? Am I likely to stumble over his corpse somewhere between Whiterun and Riften?
The same could be asked of other Followers and Horses. If I buy a horse in Whiterun, take it to Riften then buy another there and start using that one, will the Whiterun Horse wander back to Whiterun and get eaten by a pack of Wolves or trampled by Mammoths on the way? What about Followers? If I take a Follower from Riften and then dismiss her in Markarth, will she walk the breadth of Skyrim to get back home... and never make it? I think this latter is pretty important since some quests force you to dismiss your current Followers.

