Most of the amulets I find clip through any armor I wear, but not in a way that it would look good but just parts of amulet are visible through.
Is there any way to fix this?

I'd prefer the opposite. I've found some really nice amulets, but they don't show up through my armor at all.