the mod needs to be saved for this.
When you're selecting which files to load in the ck theres a Details button at the bottom of the window. Highlight the mod in question, click details, and you'll get a list of all the new/modified stuff.
You can then highlight an entry and hit the Delete key to stop that entry from being loaded the next time the mod is loaded (essentially erasing it from the mod).