Assign him a custom voice type, maybe?
You'd need to provide new dialogue to fill everything. Hellos, goodbyes, combat taunts, what they say when you're hiding from them, etc etc.
Because otherwise, your NPC will either say nothing (with a new voicetype), or revert to the default voice for these situations.