just tell em to "wait here"
That isnt an option with thralls
Use any other type of conjuration, like bound sword, and you will dismiss the thrall.
The bound spells do not dismiss the thrall. Conjuring other atronachs or familiars does dismiss them, but then I have to wait for their timer to run out.. which is two minutes.
Is there really no way to dismiss them without killing them???