Well,Im really confused,they wore elf armor,they were 7.
5 melee and 2 mages,the mages wore something cooler though. But wierd as well.
Were these special imperials? highly ranked or something?

You're probably mistaking them for Thalmor Troops. If that's not the case, then i'm not sure.

Sounds more like a group of Thalmor troops, as mentioned. The Imperial Legions soldiers normally doesn't have mages either.

Were they tall and had big ears and had light green skin?

That sounds like Thalmor. You see them a lot in Imperial territory. The Imperials hate them too but they're hands are tied because of the way the law is. I've heard Imperial soldiers will kill Thalmor when they are alone and if you get caught killing Thalmor in Imperial territory they only charge you 40 gold for litering.

Be funnier if you walked up to them and it said "Stormcloak"

I'll give you a bit of advice;
Kill them. They deserve it.
Unless they just turn out to be a few people with a good fasion sense
Yeah, they sound like Thalmor. They're allied with the Imperials, but are kind of like the "secret police" of Skyrim.