So im starting off a new pure mage character, but Im seriously under equipped early game as staffs and such cost a packet and are rare and crap to boot. Is there anywhere near Whiterun early on that has a staff and/or mage gear in general? I cant find anything mage specific in the treasure locations I know of atm.

Not Whiterun itself, but head to Winterhold and the Mages college there.
Get the starter quests as suggested when joining. They lead to a couple of dungeons with a more mage orientated opponent list that enables you to grab a few mage staffs, and get used to mage on mage combat.

Yeah Im heading through whiterun and windhelm on my way to the college but getting there is going to be tough. Thats why I was looking for some gear laying around that might be useful, like I know there is an ebony greatsword on the hill right behind solitude (treasure location) that kind of thing.

At the college of winterhold in the hall of countenance, there is a lightning staff on one of the shelves. You have to steal it though.

In the first mage quest dungeon, there is a good staff on the altar near the final boss.