I can't put weapon in the glass case, do you have this problem ???

Place it manually by dropping it and using the grab function.

Yes, this^

There's no 'click and drop' in Hearthfire houses, you can put whatever you want in the case by the above method.