» Mon Jun 11, 2012 3:37 pm
I've yet to encounter any showstopping bugs playing the game, aside from rare CTD, and occasional alt+tab related CTDs. However, I got the game for Christmas, haven't sunk nearly the time into it as most other people here, and tend to play very carefully -- knowing that Bethesda's games tend to be exceedingly buggy at launch, I've read up on bugs in the game and how to avoid them.
But I have sunk some time into the CK since it's been released, and I'm really seeing a pattern to the nature of the bugs, both the ones I've personally experienced, and the ones I've read about. A great many of the bugs they didn't catch (i.e., the ones we, the players, are encountering) don't occur if you do exactly what you're supposed to do, when you're supposed to do it. But in a game as open and free as Elder Scrolls games tend to be, you really can't expect the player to know, or even desire, to do things a specific way, or in a specific order.
I think the testers, whether human or automated, knew too much about what you're supposed to do, and didn't deliberately try to break the game. I also think that the way the developers use the CK, demonstrated in their official videos, and also the only way a bunch of things work in the CK (extensive copy+paste, find&replace, duplicate existing assets and renaming them, rather than creating new entries) is pretty counter-intuitive to anyone who wasn't the developers, and doesn't have an extensive knowledge of the game's assets.
The way the CK was designed, the way the game, and the quests, etc. were all designed, was intuitive to the developers, and so when they played the game to test it, they played differently than an outsider would. They may have tested everything every possible way they could think of, and fixed all the bugs they found, but their own knowledge would frustrate their ability to approach and test as an outsider. The majority of the playerbase could encounter a bug that the developers did not, simply because of that difference in knowledge affecting their approach to playing the game. The players all come to the game with their own idea of what they want out of it, or how it should be played, and each developer or tester would too, but they also have the knowledge sitting in their brain of how it was designed to be played.
In addition, we certainly aren't using the build the developers and testers used, for Skyrim or the Creation Kit. At least some of the bugs we're encountering are likely to be a result of a different build process, of code that was stripped of dev/debugging/testing code, but never itself actually tested to see if those things were removed without damaging the final product.
But the real kicker is that very few programmers in the industry really know what they're doing. Most of them can hack something together, make a product that works most of the time, but there are very few who really understand and can write good, clean code. The rest of the computer industry moves so fast, but software development, and education haven't kept up. They're largely held back by C, and the multitude of variations spawned from it. Most serious software is written using some C variant, because of performance, and because it's the industry standard. But the language itself doesn't encourage good code -- in many ways it actively encourages writing bad code.
It's part of the culture too -- who cares how buggy it is, as long as it does what it's supposed to do, at least some of the time? The problem is that the people who care about good code aren't nearly as "productive" as the people who write bad code. Features impress far more easily than the stuff behind the scenes, because the features can be seen. And delivering features performs better in the market, because people are easily dazzled by features, but it takes time to see the flaws.
So, in a way, it's ultimately the fault of the market. When customers demand that they be given things now, rather than a better product later, they shouldn't be surprised at what they get. Hopefully Bethesda will follow through on their promise to keep patching Skyrim, and the CK as well. They didn't provide very good support for Oblivion.