I summoned him once and now he wont go away. Is this a know bug? he has followed me into whiterun as well

If this is the first time, make sure to talk to him, he gives teaches one word for a shout each time he's summoned (for the first 3 times). I'm not sure if he'll actually despawn if you don't talk to him.

He followed me through a fast travel or two before he disappeared. He just wants to hang out in Tamriel for a while is all.