I went here earlier and killed a load of bandits who had occupied this fort, i came back a few hours later to see imperial soldiers now occupy this fort. They are friendly towards me and i am sure the structure has undergone some changes such as a wood hut has been erected over an anvil and forge etc.. This is a really neat feature.