Yeah go for the Lovers Stone it will help level all three faster.
Unless you're like me, who likes to get the Lover's Comfort buff. If you have a spouse, you can sleep at the home you both share to get the 15% bonus to skill improvement. Having the Lovers' Stone buff precludes that.