I am getting these rock textures inside of a mine.

http://i.imgur.com/Pj2fq.jpg

http://i.imgur.com/oKQ6j.jpg

I have tried Re-Defined Dungeons

and Serious Retexture

Have you taken a look at these:
http://skyrim.nexusmods.com/mods/1382/?tab=2&navtag=/ajax/modimages/?user=0|:|id=1382

In the files section you can install just the Caves textures in glorious 4k^2

Thanks for the link, but I found the problem and it isn't from the caves folder.

The problem is with this folder
Data>Textures>Dungeons>Mines

The textures in the Mines folder are messed up, but I cannot seem to find the mod that installed the Mines folder to begin with.

I tried deleting it, but then the rocks load no texture at all.

Well, even if the folder is supposed to be there in the first place deleting it would have told the engine to load the original texture so...Sounds like an .esp directing the engine to search for the texture in that folder, which I think would cause this problem. Do you have any mods that affect caves/mines? If so, I'd start by deactivating those to see if one is the culprit. If that doesn't help, I'd start with the most likely candidate and work my way through my mod list until I found the problem.

Hope that helps. I'm afraid that's gonna be about as far as my usefulness goes. Good luck!