Would like to pull 1 perk point off that i used.

You need to know the perk ID number. For instance, to remove Apprentice Destruction it is c44bf as found on the table http://www.uesp.net/wiki/Skyrim:Destruction

player.removeperk c44bf

I haven't played with it much but would strongly recommend being careful with this command as I can't know if it will break anything. At least I would recommend removing perks in the order you added them or at least not breaking their dependencies. For instance, I wouldn't remove Novice Destruction before Apprentice Destruction.

Edit: If you are viewing the perk screen as you do this you'll need to exit and re-enter it to see the change.

So will you get the point back? Or would you have to use another console command to place a new perk?

Sorry but I hate "cheating" or using the commands; and wouldn't do it unless I could just replace it.

From my limited experimentation you do NOT get the point back and must use the addperk command to place it somewhere else. I'd recommend some experimentation and keep a save point in case things break much later on. Naturally I'd also recommend only adding a perk that you would otherwise be eligible to put a point in.

I try to avoid using console commands for normal gameplay as well but it comes down to weighing the options. If spending a point you later regret is obnoxious enough that absent the console you'd have started all over, I'd go with the console. Personally I'd see it more as 'cheating' if you swapped the points around opportunistically to benefit certain encounters. Fortunately the beauty of TES is that everyone can find the balance that is right for them... well, at least if you play on PC anyways