They are avoidable even at a very low level
Sprint past the first two in the hallway, drop down in front the raised bridge and keep running into the next chamber and lock yourself in the back room and hide til they go away.
Leave the room, turn right through the oil puddle staying hidden and there'll be an unarmed guy with brawling gloves in a right room full of bear traps. Fire an arrow into the previous chamber so he goes investigate (Alternatively, lure him to the oil puddle and knock the oil lamp off it's mount so it ignites the oil and burns him alive). Quickly run through the gate at the far side of the bear trap chamber. Pass through the chamber with the axe block and you'll come into a chamber with a criminal scum dude having a drink/cheese nibble. hug the wall to the right going behind the cart (remove your armour to stay stealthy if you have to), and you can reach the stairs undetected even though you might not think you can.
Go down the stairwell and you're in the flagon,
