That's interesting, you think it was a glitch?
Anyway, thanks for responding guys...too bad I was excited to find something extra creepy..
Nope, just an easter egg. Try following him until he stops!
PS: He can be found riding in most parts of skyrim, good luck!