Every once in a while I will be running through a room, with stuff like plates and books on the ground, and I will hit something and lose some health. Does all impact from these items cause damage? Can you use them as weapons? I know there is a telekeneses spell out there that can throw stuff but I am unsure if it is in Skyrim and haven't had a chance to use it.

That sounds odd. The only time I've noticed touching inanimate object makes you lose health was with rock previously dropped from traps, i.e. the stones already being on the ground and just running into them makes you lose health. There is a telekinesis spell in Skyrim, although I haven't been able to use it successfully myself (I tried reaching for some potion once and for some reason failed; haven't tried it ever since). I've read, however, that you can use telekinisis on a sweetroll to kill Grelod so it seems like this spell can indeed be used to deal damage.

I think every item has the potential to do damage. It's just uncommon for most items to harm the player, aside from items such as kettles and buckets.

Telekinesis is indeed in Skyrim - I'm fairly sure it can be found in Labyrinthian, during a certain questline. It's actually possible to kill Grelod the Kind with an item - she only has one point of health, meaning any damage will kill her.

Walking through a pile of items often causes damage. Usually piles of bones, but sometimes plates and other misc. crap can do it also.