Yeah, I am not perking all three of the crafting trees, but I enjoy crafting things so I am using them. I don't mind getting my butt kicked every once in a while. It adds fun and challenge to the game, and I'm pretty tough against bandits and mages. Its animals (bears, sabrecats) I have the most trouble with. I only use bound weapons. But there is no bound shield spell so I use a real shield, when I am not casting spells. I also use destruction on occassion which does not help with the spreading issue.
Here is my perk plan up to about level 52 (I am currently around level 20). I'd welcome thoughts, suggestions.
Archery 8
Overdraw (5)
Eagle Eye
Steady Hand (1)
Power Shot
One Handed 5
Armsman (5)
Alchemy 8
Alchemist (5)
Physician
Benefactor
Poisoner
Illusion 9
Novice
Hypnotic Gaze, Aspect of Terror, Rage, Master of the Mind
Animage, Kindred Mage, Quiet Casting
Dual Casting
Conjuration 7
Novice, Mystic Binding, Soul Stealer, Oblivion Binding
Necromancy, Dark Souls and Twin Souls
Restoration 6
Novice, Regeneration Necromage
Respite
Apprentice
Ward Absorb
Enchanting 8
Enchanter (5)
Insightful Enchanter
Corpus Enchanter
Extra Effect
Oh yeah suggestions. First- loose all the archery perks except for the 5 damage perks. The rest are fluff and sneak hits with ebony bows and the damage perks do it just fine. there is -3 perks.
One handed- SpellSWORD. You need the perk to reduce power attack costs (which lets you have fewer levels spent with stamina) and you need the +25% damage power attack with chance to decap. These will make your main form of damage much more effective. that is +2 perks.
A big part of your problem is probably because you are using bound weapons, and those will not really scale with your characters power throughout the whole game. I highly suggest getting ahold of a nice sharp blade and constantly improving it with smithing. A spellsword cannot use destruction to hurt things really and 1 hand is our only option so it needs to be maximized, and buffed with fortify-one-handed.
Ward absorb? Really do you use wards? I think I used one once when I had to block a fireball at the mage hall. Other than that they are pretty poopy, they really limit your mobility when you have them active as well.
Restoration I suggest dropping apprentice casting. Novice casting opens up the whole tree. Necromage is super-powerful if you go vampire- which I suggest since you will be using alot of spells as a spellsword.
Drop alchemy or tone it down so you can at least get 2 perks for arcane smith.
Soul stealer on conjuration- that might be ok if you are trying to RP with it, but really it is redundant considering the easiness of trapping souls.
I took light armor instead- stamina buff and quick sneaking competence are too great to ignore.
I took alteration instead of conjuration, I don't use followers or summons. Mage armor extended and amplified for the vampire is great and allows you to take fewer light armor buffs to reach the cap, not to mention paralyze? what a great spell to team up in your offhand! and of course the excellent magic resists, and detect life and detect dead. With both the detects running I don't think I have been suprized from an enemy in ages.
I took rune master for fun- it costs 3 perks BTW. since I like slapping runes at choke points or in front of me when I set up an archer position with my bow. with quiet casting you are free to use all the runes and spells you like with no hindrance to stealth.
Anyways- I will start working on a guide. Please respond with a bit more detail about your ideas and maybe we can pool our thoughts.
Below is my build- breezing through master. I don't have atronach from alteration yet, deft movement, or avoid death, I have 2 perks extra waiting for the skill increase.
I also didn't take assassin's blade because I already have invisibility and if I took that I would just go around one-shotting everything in the game again.
http://skyrimcalculator.com/#82522