I get caught pickpocketing a lot. I don;t like to reload because I think that is cheap. Instead of a Dead if Dead character, I play a Busted is Busted.
So long as you don't get caught and put back in jail before you get to it, your loot will be there. If you get put back in jail then I think its lost forever.