I have killed every last bandit (or mage or whatever) from some forts and the map won't read "cleared." So I continue to look around thinking I must have missed a room or something somewhere and then, still finding nothing, just move. Later, that fort turns up occupied by Stormcloak or Legion even though the map never indicated "cleared."
On other occasions, I have gotten the "cleared" tag on the map and then on a subsequent trip by/through that fort, I get bandits shooting at me even though the map still reads "cleared".
Anybody notice anything similar?