You can certainly survive with just light armour, but you need to try not getting hit too much, which means stealth (and stealth crits) is your best weapon.
Also going for the legs/wings instead of the head can sometimes pay of better than going for the head out of stealth. If you aren't going to kill it, better to cripple it than just make it angry

Oh, and don't forget mines.