There's a mod that lets allows you to craft soul gems out of the fragments ...

Yeah, and I'm using it but I'm not sure which one it is - maybe part of deadly dragons? I've lost track, I really have, 104 esp/esm modz, 10 SD/SKSE plugins & every decent retex worth having. Skyrim folder 13.9GB and rising!
Anyway, the fragments (three of four different 'flavours' even if they look exactly the same in the inventory) can be used to make small dragon soulgems, those in turn make dragon soulgems, which can be used to improve the 'dragonslayer' armours found as loot on dragons, or to make some special spellbooks & items.
...but I think the 'vanilla' fragments are in fact totally useless. Another ball dropped by Beth to make the deadline?