Does anyone know if you can get a different bard by firing him then later telling your steward to get a bard?

I made the mistake of building Lakeview as my main/family home. Then I come to find that both of my other houses come with bards that happen to be lovely ladies with pleasant voices. But, thanks to irreversible building choices, I come home to that Nightingale dbag who keeps bumping me while I'm placing things on my mantle (I swear he and Vigilance are conspiring to make me drop my Bugs in Jars). Also, wifey walks around in her underwear and I don't trust him.