I know daggers are affected by armsman and are not affected by one-handed enchantments.

What about the perks fighting stance, savage strike and the dual wield tree (dual flurry, dual savagery)?

All perks work with Daggers.

It's just Fortify One-Handed enchantments and potions that do not help daggers.