Yup, exactly why they found the heart of Lorkhan, which was a god. If they didn't believe in him, they'd of just thrown it back underground.
It was the manifestation of a
story a metamagical remnant of Creation.
The Dwemer knew such a thing must exist as their tonal architects long ago gleaned the nature of the world through zero-creation, anti-creation and harmonics.
The Dwemer saw nothing profane in utilising the Heart for their own means, which is where the ungodliness comes in.
Few, if any other individuals or races would have used the Heart for something so anti-Mundus.
Even the Tribunal used it just to climb a spoke.