Arrows not disappearing from the body is a common bug.
On pc, open the console and type:
sixchange [enter]
sixchange [enter]
The above command switch between the male and female meshes and, for some unknown reason, remove any decal or unwanted prop on the body
Don't do any operation between the two commands or you'll might be stuck with a screwed body mesh.
If you're on console, I do not know of a way to fix this bug, save reloading an earlier save.
PS: 25 responses and not one that pointed to a solution. You're note being very helpful, especially with newcomers!