http://i.imgur.com/yIBz5.jpg
And he won't move at all. I tried closing the game and re-opening it and he's still stuck.
So I went to the wiki page to find out console commands thinking oh I can just summon another one of him and he'll do his thing and the dragon fight will start.
Well, a dragon fight DID start.
http://i.imgur.com/fKrj8.jpg
Re-loaded my save and then got next to him in the rocks, brought up the console and clicked on him then typed "disable" and hit enter. Boom. He disappears and what's his name automatically crawls out of the mound, the fight happens and the quest completes like normal.
I couldn't find any info on this anywhere so I thought I would post my findings and solution here in case anyone else encounters this frustrating bug.