I wanted to start a mage I started putting perks into destruction but now ive decided I want to try conjuration , should I just start putting in perks for it or start a new character?

Depends on how far in you got doesn't it?