When someone says they think it's silly to be shouting at the tv I take that to mean they feel they will have to be shouting not that they are executing shouts by talking normally.
I think they are just being melodramatic. If it was not a dragon shout game, you probably would see a lot fewer people referring to it as "shouting." Personally, I am not that interested in talking while I am playing a video game. I kind of get into a groove and using my vocal chords would seem like a distraction.
I have an Xbox but no kinect and I play skyrim on the PS3, I am not interested enough to buy a kinect. But it sure does sound like a good thing for those who are able to incorporate it into their gameplay.
Now, if only kinect let you see your health/magicka/stamina bars and onscreen text while your HUD was off, then I would have to buy one immediately.