I tried to do a clean install for 260.89 and it said it worked but I still have all the older drivers in my NVIDIA folder and all the driver folders have all the stuff in them. How do I just uninstalll them because I dont think doing a clean install for 260.89 is going to work? Can I just delete the folders?

You can download a free program called Driver Sweeper that will seek out and delete Nvidia left-overs. Uninstall the drivers through Control Panel/Uninstall Program, reboot, run Driver Sweeper, select Nvidia Display drivers, anolyze and Clean, reboot again, and install the new drivers. Windows New Hardware Wizard may get in the way when you reboot, but as long as it just installs a standard VGA driver, you can proceed with the Nvidia install.

You missed a step. After manually uninstalling, reboot into Safe mode, then run Driver Sweeper.

But yeah, Driver Sweeper does a good job.

I've found Safe Mode to be unnecessary, but if you get any errors from Driver Sweeper about not being able to delete the files, then Safe Mode will solve that.