I have no desire to attack a Dunmer just because he is one. This isn't WoW. Races in TES get along for the most part. Calcelmo from Skyrim didn't get crap for being an Altmer. Neither did Chancellor Ancano from Oblivion. I don't want to go into High Rock and get attacked on sight by a bunch of npc's. Until I'm standing behind Queen Ayrenn on the battlefield, consider me an Altmer and nothing more.
Maybe the pvp could be added to more than just Cyrodil, but making every foreign zone hostile makes it seem like you're forced to be branded as a soldier of the enemy faction and not an adventurer. If I'm in Cyrodil, my intentions are clear. Was every Altmer in Skyrim a Thalmor?