As far as I know that is how it is supposed to be.
The "classic" display cases in Skyrim could only display weapons (by putting your equipped
weapon into it). The display cases in Hearthfire are for displaying anything that fits into them,
like gems, artifacts, rare books etc.
It's a little tricky to put and arrange items in them, expecially since the items tend to leave
the cases (I reported that bug right below your post
