I didn't realize this, but you can meet Taron Dreth even when you do not have atherial stuff equipped or in your inventory. You get different dialogue options in this case. I asked him where he was going and he said he was heading to Markarth to consult with Calcelmo.