If you don't want a Steel Sword to beat out a base level Glass/Ebony/Daedric weapon, then there are really only a couple of options:
1. Put more Perks into Smithing as you are able, that way all weapons scale at the same rate.
2. Don't put perks in any part of Smithing. You can still upgrade normal weapons, but at only a fraction of what you can do when compared to someone who has the appropriate Perk.
3. Don't use Smithing. Just use whatever you find in the field, and never try to upgrade it.
I first cringe, and then shake my head and laugh when someone says: "Well then don't use/upgrade/whatever XYZ skill/perk/whatever".
I think the problem is that smithing levels continue past legendary. So I can take a steel sword, put on my smithing enchanted gear, chug a potion, and upgrade to the stratosphere. If smithing stopped at Legendary base (+20 for armor, +10 for everything else, according to UESP), then there'd be some real reason to buy higher perks for glass and daedric weapons. Right now you can upgrade a base level weapon to be strong enough to handle anything.
But I also think that the heavy armor perk that doesnt slow you down and weighs nothing should be changed to make heavy weigh nothing
but only reduce the amount that HA slows you. But then again that whole perk tree needs to be reworked.