Falkreath is too far from everything, even though the spot is okay (just kill the conjurer, seriously).
I think it's more or less about how much of an immersion breaker it is to have your kids running around playing in the yard right next to a corpse and a magical necromancy altar.

Same with building your house next to a bunch of giants.