When talking about Precursors in media, I always fancy Aztec-style architecture the most (like Markarth, and Ilos if you played Mass Effect).
Dwemer are not precursors of any sort. They are simply another race of mer, like the Altmer, Dunmer or Falmer. (Hence why calling them "dwarves" is a terrible misnomer, and pointed out as such in lore. They're actually elves.) The reason why they're regarded as so "alien" is because they were extreme isolationists, rejected all their neighbors' ideas, and went merrily on their own scientific way without sharing their insights with anyone.
Dwemer marched to the beat of their own scientific drum, sure, and they advanced leaps and bounds beyond what other races managed to accomplish in the same time span. But they didn't precede anybody: that would imply that another race followed them/were "heirs" to the proverbial Empire, which didn't happen. The only technical "Precursors" in TES lore would probably be http://www.uesp.net/wiki/Lore:Aldmer (not to be confused with the Al
tmer we have now). They're the precursors to the Dwemer themselves, actually.
The style of Dwemer ruins has been long established in lore. It wouldn't make much sense to make Dwemer ruins look like Aztec architecture at this point in time.
^ This. Although retconning has happened before...I seem to recall Cyrodiil originally being mostly swampland, for one. "The Roman Empire but with more rice" or something like that.

Still, retconning the Dwemer is considerably less likely to happen, given how prominently they've already featured.
I though in MW they looked sort of Babylonian
Steampunk techno-wizard Babylonian, maybe.

Actually there is a little Babylonian influence in the exterior towers and the statues you see scattered around, especially. The interiors not so much.