I think that's a reasonable question to be honest. My bet is that the opposing factions' castle gets destroyed or the enemies just stop respawning.
But I think it would be amazing if you could keep the opposing castle as your own, kind of like a trophy of victory haha.