I have just started the Clavicus Vile quest by speaking to the statue.. prior to talking with him i had to fight some vamps and in the prices I collected an ice spike through the waist.
It has been a couple days now and i still have said ice spike hanging out my back.. i often play 3rd person and get to see this ridiculous think sticking out of my guys back!

Has anyone else had this happen? and were you able to make it disappear? I have tried saving and reloading in 1st and 3rd person.. no dice.. still there.. most displeased!

You can try stripping naked and/or sleeping in a bed or letting enemy archers fill you with arrows, but the only thing that works every time for me is to shape shift into a werewolf. If you don't have lycanthropy, I don't know what to tell you.

i collected an arrow at some point which did get rid of it.. so that is good... however..
now i have another one!!!!!!!!!!!!!!!!!!!
honestly wtf?!!
Im just happy getting hit with an arrow removes it.. its a start, but would be nice if developers fixed it.