well you could
1. not exploit the fact that you can carry stuff around without being scolded for it
seriously if the fact that you can move stuff around without getting yelled at and take it to some corner and steal it easily bothers you, why would you do it? thats like saying i dont like using magic but here let me only use fireballs in combat.
as for the stuff being white, if you want to really feel like you are stealing from someone why would you be stealing the low value items in the first place instead of the high value red items? if that is truly what is happening in your game.
ill get back to you after i go to the alchemy shop in whiterun to check for myself
so i can just go around picking stuff up, and most of the stuff was white so its not a bug or glitch on your part. but i still stand by what i said earlier.
and now im gonna go to a city im not a Thane of and see what happens.
so i went to windhelm general goods store and even the wooden plates were red so i think the reason most were white in whiterun is because of the status of thane and how much people like us.