Heh. In my first game Lydia is sitting in my bedroom in Breezehome, eating bread and spying on me and my husband when we sleep (so I avoid the place). I don't want to kill her, that would be out of character, but I hope to recruit her to the Blades soon so she'll be out of the way.
When another of my characters got Lydia I made the wise decision to put a helmet on her. That made her sarcastic "I'm sworn to carry your burdens" slightly more bearable. Then I did Missing In Action as one of my first quests, and she got killed in the general mayhem when we stormed the fort with Avulstein Gray-Mane & co. I was quite relieved... No bedroom stalking Lydia on this game!
(Though I felt a little bad leaving her there among all the dead Thalmor, she IS quite a good follower despite the fact that she seems to hate being a housecarl - so I decided my character could keep her armor as a memory.)
I have a feeling that one's view on Lydia is somewhat genderbased
