The Heavy Armor perk Matching Set is not working for me for a full set of ebony armor. It is working for my orc armor set, but when I swap to a full set of ebony, the bonus doesn't kick in.

Is anyone else having this problem?