I am pretty sure the exact same method that works for the other two versions works for the PC version, you just need to reload that area, nothing to do with saving or exiting the game, or I am sure the board would have been full of PC players complaining about needing such a rediculous a method just to arrange a few objects. Just having to go out the door and back is bad enough.
The issue with items returning to their original locations doesn't happen very often. I've never hard this issue with any other house aside from Windstad, for example. Also for some people the quickload/save option work, for some it doesn't. If it doesn't work, it doesn't work. I'm merely suggesting a potential solution, that's all.