I use DW and light armor myself on master level, and yes, at the beginning it's a nightmare. I had to rely on followers in my first 20 levels, lure the enemy to them and attack them while they are busy with your follower/meat shield.
after you invest in some light armor perks things will start to get better, the last perk is a MUST.
If you think you are too weak level up some sneaking too.