I go up on horseback, then charge past him as soon as he drops.

Why? You'd be faster on foot!

On a more serious note, 1st time I came there I didn't have as much problem with him because I already felt the pain of the ice troll upon arriving to Labyrinthian and learnt not to mess with them.

Also, 2 levels? Save more often.

Still svcks to hear it man.