In that case perhaps stealth daggers should be left be and if folk don't want to use them perhaps they shouldn't use them.
That's the whole point to 90% of the arguments here. All of the problems that the nay-sayers are talking about are directly linked to choices they've made and Perks that they've
chosen to take.
If you don't like how lethal all of the Stealth Perks make you with a Dagger, then train your Sneak Skill but put no Perks in it. Or just don't take the damage modification Perks.
It's all the repercussions of their own choices that they're complaining about, not design "flaws" in the game.
If you take those certain Perks, then they work in a certain way. the game is functioning as it's designed to function. What they're really unhappy with is choosing what they did without properly or completely thinking about the ramifications of said choices.