Oh noes! It might increase by 2 points! /gasp, it's the end of the world. You don't have to put perks in conjuration, If i was that worried about skill increases i would have gone insane by now, like having to heal myself when i run out of potions on my pure warrior, yeah my restoration goes up by like 1 point, but at least i'm not dead.
