That could be tough build, as you are usually pretty tight on perks doing a spellsword...unless you're going to lvl 81
Well it depends, if you're smart about the perks you won't. Don't take 5/5 of the damage increasing perks and take the steel and arcane smithing perks rather than half the tree. Use any fortify smithing gear you find and potions you buy, you will be fine.
The only problem with that method is the damage gap between 2h and 1h rapidly closes, later on you will end up with a sword that does 60 damage but a greatsword that does 75, for example. I tend to limit weapons depending on their weapon speed. If one of my characters uses daggers and swords, I'll reduce the damage of the dagger so they're equal.
The game doesn't do this, axes and maces are quickly inferior to swords and daggers are even stronger when smithed. Battleaxes have the same swing speed as greatsword and quickly outperform warhammers as you progress. I still prefer warhammers though, they have a larger stagger value.