OK, I just tested it with the "Butcher Journal". I went to Calixto's House of Curiosities, guard saw me enter at first so I exited, went into Sneak mode and went back in.

I stole it from the chest in that small attic-like area, went to Dragonsreach, put it in the barrel, had Mjoll take it out, and when I got it back from her it was clear.

...I never steal anything.
You should try it - it's liberating.

FWIW: I only steal stuff that I can't get by other means...or stuff in Radiant Raiment if I'm passing by at night just because I don't care for the chicks that run it.
