They said it to my Imperial too, and she isn't even a real Imperial. She was born to Nord parents in Skyrim, but grew up in Cyrodill and married a man who became an Imperial General. He was betrayed by The Emperor and murdered by Gen. Tullius, leaving my character a widow. She came to Skyrim seeking revenge on them both.
http://farm8.staticflickr.com/7146/6807476353_8d906268e7.jpg
Infiltrating the Imperial army then doing the double-cross was great, but it would have made RP'ing that character more convincing if there was less racial recognition in the Civil War quests
http://farm8.staticflickr.com/7199/6940401119_ff10bc72b5.jpg