I tought he was cool in the beginning of the game. But Im a Dunmer... and when I arrived Windhelm... I TOTALLY HATED HIM. I wanted his barbaric head in a pike since there.
Ulfric never says anything against the Dunmer. He also maintains the precedent of previous jarls of allowing the Dunmer sovereignty- so, what's to hate about that? You've been listening to that skooma swiller Ambarys too much. Even the other Dunmer think he's off.
I dont care the invader lizard-people, they diserve to be treated like that, they′re just lizards.
But he must pay for what he done to my people. Damn nords.
They gave the Dunmer refuge without asking any compensation or promises of fealty in return. Yeah, those damn Nords.

Maybe you need to make a trip to the Refugee's Rest and read up on recent (by elven standards) http://www.uesp.net/wiki/Skyrim:Decree_of_Monument.