I'm not opposed to combining the two. For me its the difficulty of integrating what I know about Tamriel (how it works etc) into a new schema - do all the same rules/tendancies apply (are mothships powered by light/magic funneling in through the Magnus-sized-hole pouring from Aetherius)? TES has both sci-fi and fantasy elements (see LIminal Bridges) but this story is almost so far into sci-fi that I'm having trouble seeing how it relates to the world as I've read/experienced it.
That said I do love it and will continue to read it. But my head will hurt. And that's the point of Lore, no?