Join it if you want. There is a ton of stuff you can do without any relationship with Nocturnal.
At one point you will be asked to go to a certain secret cave and put on a suit of Batman armor. At that point you should start thinking about walking away and forgetting that particular quest line. You can still do a ton more Thieves' Guild quests though and Nocturnal will never bug you.
Personally, my Dunmer serves all the Daedric Princes equally, even the ones that oppose each other (he subscribes to pre-Tribunal teachings), but if you want to support Azura, I completely support your RP decision.
