» Mon Nov 05, 2012 1:43 pm
Some companies have hand-picked closed beta testers from their long term forum users...in general, they're given a specific test copy, with fairly clear and concise guidelines, and put on non-disclosure agreements.
Having compared the difference between the efforts of closed testing groups, and open testing groups, I'm definitely of the opinion that open testing is largely pointless from a constructive viewpoint. The basic problems or dysfunction can be found by one person, rather than xxx people, and if you are looking for balancing or mechanics issues, you need a small number of dedicated testers who put a lot of hours in, rather than a large amount who onley spend a few hours on the test. On top of all that, by the time the game development process goes to external testers, its' format is already locked in, and it would be very very rare for any conceptual change to occur...and a lot of those types of suggestions are opinion based, and once your test crew starts having differences of opinion, you may as well close them down and start with a new crew.