Not the worst bug I've encountered but somehow the shout has become permanently affixed to my sword.

It's likely that only the sound effect persists. You may want to look http://uesp.net/wiki/Skyrim:Elemental_Fury for possible fixes.