I have been working with NCR mostly, and I had to go and "remove" Mr House for them. So before I kill him, I had a bit of a chat, and since I last saw House I've got the Boomers on my side, etc. So I tell him in hope to get some EXP, but he just gives me another quest. Suddenly the NCR somehow find out I'm working for House, and refuse my help in the future.
So anyway I reloaded, and I killed House. I was considering killing House already to take Vegas for myself, so I am just wondering, if I return to Yes Man and tell him I've got rid of the Omertas and I have the Boomers on my side, will working with Yes Man result in gaining infamy with the NCR, and will they refuse to let me work for them again?