That's bascially what I've read. I assumed Alchemy would be good for poisons but by the time you get the x15 multiplier plus those gloves, the target dies anyways. If it doesn't, just run away and hide and do it again. I just don't want to waste time with Alchemy if it really won't be necessary.
Poisons would definitely be useful for an archer based character since they don't have those obscene sneak attack multipliers. But if you're going dagger, just forget about it - I really see no point in trying to raise alchemy other than making mana/health potions, which is probably what I'll end up doing in the late game. However, there are some effects that are really useful, like slow or paralyze. Straight damage poisons are a waste on daggers, though, as it is simply overkill. Only named creatures or big monsters (like giants) are capable of taking more than 1 x30 backstab, and my sneak is high enough that I can get several of them off before they even know I'm there. The downside to my character is that I really can't take hits at all (but I also force myself to wear good looking armor that may be crap in the long run). To make up for that, I started working in magic to round myself out. Between my backstabs, my archery if I'm feeling frisky, and my spells for close-encounters, I make do very well.
I guess it really depends on what you want to do.
If you want to do dagger, I recommend taking destruction and other magic. Or, I suppose you could go full 1h - the only problem is that if you keep doing backstabs, you'll hardly ever raise it, so it'll be kind of crap unless you train it. If you go archery, definitely dip into alchemy as it would help them out a lot. Enchant is definitely useful for anyone, as well. On the whole though, if you're going for an assassin type, Sneak is the first thing you need to raise.
I also never raise pickpocket - though I suppose it would be useful if you actually want to be a master thief. Technically though, with a high sneak you could steal just about anything that isn't nailed to the ground anyway. Pickpocket is obvioulsy just for stealing the small crappy amount of gold someone has or some other item, but I find it hard to imagine that there is anything good to come of it. I've actually never looked at that tree either. Lockpicking is also only there if you svck at the minigame. It takes some practice, and I can see it being kind of annoying with a controller, but once you get used to it, it's fairly easy. Only master locks give me a problem at 30-40 lockpicking, and thats because those picks are seemingly made of brittle clay or something. It's still possible to do it though, it just might take 20-30 picks. Not very efficient, but I've only ever run across 2 master locks and I'm 23-24... still, I haven't done
that much exploring yet. I've been working on the Dark Brotherhood and other minor quests. Hell, I haven't even gone to the peak yet to meet the greybeards. I killed the first dragon and then wandered off.
Barter I don't really see a point in unless you want to give a merchant a lot of gold to sell stuff. But, as it is, my Imperial has 25k+ gold and I have no idea what to spend it on. I'll probably just buy mats for Smithing, which is actually pretty useful, and more so if you want dragon armor. Speech also is kind of useless. You get a lot of that just for selling to a merchant (strangely not barter, or maybe I'm just seeing that wrong...). Anyway, the above skills I noted are probably all you need to worry about as an assassin. I just don't see myself using anything else, or having any need to.
But also; the magic(s). Destruction is my filler ability for damage. I rarely use alteration, but I have it in case I want it. Illusion is fun with frenzy and fear, but its not very high for me yet. Restoration is a must for the healing spells. Conjuration is just "eh" to me - I'm not a big fan of "pets". It does, however, have Soul trap, so it may be something you look at.