Hmm, so what happens when you are poisoned or diseased? Do it affect skills and the attributes that are still in?
Short answer, I do not know. Long answer: A lot of hazily-worded [censored] to cover up the fact that I do not know.
I would assume, however, that they affect your health, magicka, and stamina, as well as your skills (perhaps).