Where does Rex go after you leave him somewhere to long?

If I understand it correct, he will either go to one of your "safe-houses(rooms)" or his starting location where you picked him up at.

I lost Rex at one point and just assumed he was lost forever, after playing several hours I had to go to the Kings for the main quest and Rex came bounding out of the theater and started following me as if nothing happened.