unfortunately I already had managed to visit the graybeards at low level due to using stealth so I'm now stuck with them and no I don't agree that Bethesda did it well as really so far You've only taken part in the killing of one dragon as part of a part army and secondly Miraak wouldn't actually know you at this point since you've haven't exactly rocked the world on your own yet (i.e. not completed teh Graybeard training)
By this point you've been through at least one dungeon (to get the dragon map/stone thing), killed at least one dragon (guard tower), made it halfway across the
world realm and up the mountain to High Hrothgar encountering who knows what along the way and have been proclaimed Dovahkiin. Sounds good to me.