OT: I agree with whoever said not to clump all Altmer together. There are fanatics to every social order and they sometimes have more power than they should.
But OP's point is we're given literally 0 examples of a non-fanatic, leaving us to assume, no, this is them.
As a comparison, the majority of the people would refer to Caesar's Legion from Fallout New Vegas as evil. They enslave people, they mercilessly slaughter all who aren't suited to be a soldier or slave and Caesar doesn't really offer any personal freedoms at all. However, throughout the game Caesar will explain to you WHY he does this, and you'll meet multiple level-headed people (philosophers, priests, 200-year-old ghouls with tons of experience with the ways of the world) who support the Legion because they all believe Caesar's Legion to be the strongest and most secure long-term society for the world. "The ends justify the means" is their argument, and to support this, the game also portrays Caesar's Legion as being incredibly loyal, orderly and reliable, whereas other societies are corrupt, full of infighting and lack purpose.
But the Thalmor? They just run around saying "herp derp I'm better than you and I'll kill you if you don't go away, herp derp." None of them bother to explain why they're better, none of them bother to argue why the oppression of Talos is neccesary, none of them treat you as anything other than scum, and they never do anything good or noble for society as a whole. There's not a SINGLE ray of white light shining from the Thalmor in this game. OP would just like to hear both sides of the story, not just "herp derp I'm evil."