You're probably going out the wrong door, there's a door to the balcony upstairs to outside as well.
This is the one thing I hate about the game engine's map and radar system: No Z axis information. I mean, honestly, how hard is it to make the ticks have an arrow pointing up or down to inform you they are above or below you?