Each time when I see how far from my character that quiver is "floating" I have a feeling that my eyes are going to pop-out. How did they even let that pass?

There's already been a number of threads complaining about this, and I agree. I'm fairly certain they're going to patch this at one point, and if not, there's gonna be mods fixing it anyway.

I was hoping they'd fix this from the beta. If they didn't quick fix this blatantly obvious and really ugly error, I wonder how many bugs they actually fixed if any.

I saw there was a mod fixing this but it looks like it was taken down for some reason.

Its not a bug per say, its a design decision. Its the same with quivers and other weaponry. As far as I understand it, there is one skeleton placement for objects regardless of the size of the character or the armor worn. So on some it floats and on others it doesnt.

Doesn't bother me too much. As Gamespot said in their review of Skyrim, "It's not a game to be enjoyed up close, but instead as a whole." And I agree, the up close details are lacking in many regards, but it doesn't distract from the scale and the greatness of the game.