How do I detect which one is the culprit?

OBSE loading may fail if there is no enough RAM aviable or too much application are opened. Some application may also make the injection fail.

It fails once, but then If I open it again, it will load instantly. Why? I can give you an archive where you can replicate it , since all you have to do is extract into your oblivion folder and be done with it.