I love my new home and I bought the core decorations for it like kitchen and alchemy and bla. (PC) - How ever, Can I display my potion bottles and staves and other things like that? (whiterun) with out a special rack or case, I mean placing them on a table? or shelf?

You could, but you would have to pick them up manually, which might make it a pain in the butt.