Physique and build wise. Since they make great assassins, aswell as being potent in magic, it would make them agile and quick with some muscle, unlike the altmer who are tall and skinny-ish, and Wood Elves who are very agile however lack the amount of muscle dunmer do. (Correct me if I'm wrong.)
What do you think?