After playing the Civil War quest, it seems I can take anything in Ulfric's room, use his containers, and sleep in his bed. I think I'm going to kill him and move in. Does anyone know if his containers respawn?