You can simply deactivate Dawnguard.esm in your Skyrim launcher and then make a new character.
I would imagine if you delete the Danwguard.esm and Dawnguard.bsa files, your system will probably download them again whenever there is a Skyrim update, since your account is linked to the DLC.