» Fri Jun 22, 2012 1:46 pm
If you want anything other than a bunch of people simple playing the game, then you go for a dedicated closed beta team. Simply taking players from the community works well to develop a feel of the game, and to locate glaring issues, but to do more you need to integrate your beta testers into your development team in such a way that they can be tasked to replicate particular problems, or can run through things with your devs.
There's a couple of companies that do it, but I don't think Beth is one of them, or if so, they keep it very tight.
Edit:
I will suggest that the flaw with the current system Beth has used is that it is causing a divide in the gaming community, and it will continue to do so. For every bug found after release of Dawnguard, there will be one or more complaints that the beta testers failed. For every complaint, overly-sensitive beta testers will come onto the thread crying foul.
I'm surprised that Beth didn't require people to sign non-disclosure agreements, but then again, it is more or less an open beta and the tester integration isn't that high.