You can always keep them by not equipping them, and casting fortify acrobatics to survive the fall. Stuck in your inventory, and fortify 50 acrobatics, worse things could happen, so not exactly a bug, more an exploitable glitch. Did you have them unequipped, and have a really high acrobatics anyway?