They have both helped and damaged.
Advantages:
They have provide a huge market for publishers to target, this in turn has provide all the companies with significantly more money then they ever used to get.
They have majorly impacted on the complexity of games, so that games are easier to get into. Just look at something like Daggerfall even, that is not a easy game to start playing.
They have helped move gaming from a child's toy to an accepted relaxation tool.
Disadvantages:
Because the casual market is so huge, the old-time 'hardcoe' gamers are often left when decisions are made.
Beacuse of the fear that casuals wouldn't want to shell out for a new console, it has held back hardware and games power in general
Rather then games being simple to play, hard to master, most are just simple to play from developers missing the point.
The rise of the Blockbuster game, where tens of millions are spent on a single that is a clone of an existing product.
In all, without them the industry would be struggling, with them we get 'blockbuster' games that are fun to play, but often are too short and easy to be worth the money we have to pay. There is not YES/NO answer to this question, and anyone who thinkis there is has not looked at the question fully.
In the future casual gamers will move away from console and to smart phones for their gaming fix, as they already have a smart phone. I feel the first company to make a good FPS game on a smart phone will crush the market as the new Halo/Call of Duty. WHat will this mean for PC games? either we'll start getting phone ports (*shudder*) or the industry will have to dramatically downsize or collapse and the visual quality that we are used to will drop or not advance.