After completing the three teachers' quests to find their instruments and turning them in, I get the training and the completion notices, but their stuff is still in my inventory. I wouldn't complain if they were weightless, but they're eating up 10 lbs I could use for more loot.

I've noticed this too. Definitely a bug. Small price to pay to have all of your skills raised by one though eh?