Was in Whiterun the other day, woke up early to set off to my first dungeon. When passing the market square, I noticed I could pick up any produce on the benches, be it vegetables or cheese, with a guard staring at me from across the street.
I know you could also pick up certain objects in Oblivion, but never merchant wares. I could loot half of Arcadia her alchemist store too without any consequence.
Seems rather odd.