I've done the same, and my stealth characters had to do very little killing in either MQ. There were some fights (especially in Oblivion) which we couldn't/didn't avoid, those playthroughs were not slaughter fests.
In Oblivion sometimes his friends would come back even though I sat there for nearly 10 minutes watching their pattern. I lunge and then the horde came, ahahaa. But for the most it was smooth sailing in both games with a stealth based character.