I personally think it's worth exploring, but there are quite a few locations that could be considered redundant. The explorer perk might interest you, if only because you can see which are "abandoned" such and such and then decide which ones you want to check out.
But for me, exploring blind is just as much (if not more) fun than the quests themselves