Maybe not entirely related, but I jumped off the College bridge, and slowly moved around the cliff. Then I dropped down to the Midden's 'secret' exit, tapped jump to scale the slope - and managed to get into the college!
Something similar's possible with the Throat of the World. You can get up there even without Clear Skies!

No, that's not the "summit" I am thinking of.

I tried it off the throat of the world, but it ended before I hit the ground