The fact that Rorikstead is still intact with so many Forsworn close by is a bit wierd.
Well, Erik the Slayer does grumble (constantly) about the town getting raided a lot: "I hate bandits and thieves. Men like these raid our town every year." Wouldn't surprise me to learn that the Forsworn raided the place now and again, too.
On the other hand...maybe someone in Rorikstead's been making deals with the Forsworn? That might explain how the town's survived with Forsworn camping literally just up the hill, and why the land's prospered so well--maybe the Forsworn's ties to the land and their magic use had something to do with it? (There's nothing at all to prove that in the game, mind--I just like speculating.)
Every time I go near those forsworn camps, they're getting hammered by a dragon. That might be Roriksteads secret, they're secretly the new dragon cult!

Well, there
is a dragon cairn http://cloud-2.steampowered.com/ugc/577825802857047673/748CC2968D5466A195C32358457D6C69860FEDFB/ the town. (Now with 100% more hilariously unconcerned Erik the
Slayer Photobomber in that screenshot.) Maybe that has something to do with it?
