Same thing happened to me, my character just kept growing stronger and stronger until I wasn't matched.
So I decided to make an unarmed fighter which was fun.
Just grab the gloves of pugilist from the fist fighter in the ratway then grab the perk fists of steel in the heavy armor tree.
Spices things up for a while.