If you could do that, a warrior using only power attacks would do, at a minimum, around 8 times the damage that an equivalent mage could do.
Just because something is in-game doesn't mean it is working as intended. Skyrim is a massive game, and there are bound to be problems that sneak in. For example, did you know that if you have even one stamina, you can execute a power attack? Did you know that a vegitable soup, a food item you can create at level one in riverwood, gives +1 stamina regeneration per level? Did you know that this form of stamina regen bypasses the stamina regen halt that takes place during a power attack?
Essentially, you can combine a basic food item and dual wielding and do roughly 9 times the damage that a spellcaster can do at endgame, given they have infinite magicka. That's the difference.
Of course, range IS a counteracting factor, as are AoE effects. However, when a warrior can kill anything before their target even has time to hit them back, such concerns begin to become somewhat pointless, wouldn't you agree?
The point, however, is that no matter how you go, eliminating stamina from the equasion, or eliminating magicka from the equasion, it exploits flaws in the engine to create a level of power that was not intended to exist. Asking a player to play that way simply to survive is, at best, laughable.