When adding on to an existing building is it better to have an open stair and just extend the existing room or a closed door and make a new location?

Either works, but if you're not experienced with NavMeshing, you might want to isolate things and start with a new room until you get a feel for things as making it an extension of a preexisting room will necessitate editing of, also preexisting, vanilla NavMeshes.