Ah, but compared to having glasses on you are two points down. Otherwise the character is glitched in your favor and the penalty isn't being applied at all.
It's not supposed to be a penalty. It's supposed to be a penalty without and a bonus with.
base 5
no glasses should be 4
with glasses should be 6 + glasses benefit.
right now it's changing the base to 4 and only making it the same as not having the trait.
normally you have 5+1 for wearing glasses
now you have 4+2 for wearing glasses. Why take it?
there is no benefit, penalty only
it's supposed to remain at 5 and give+2 for 7