This, I quite happily collect quests in the journal. I then do the ones I want, when I want to do them.
What's the problem?
The problem is there's no distinction between 'quests I didn't want to do ever' and 'quests I didn't want to do at the time'. Given the lack of a proper journal, the vast majority of quests have very little information recorded down, thus it's nearly impossible to tell what quest is what, and why it wasn't done yet. I can't count the number of times I saw "Talk to Aventus whatshisname" under Miscellaneous Quests, having to enable the magic compass marker to find out where he is (because, you know, apparently having "in Windhelm about (spoiler)" is too much), travel all the way there, then realize
Spoiler it's the quest that starts off the Dark Brotherhood and requires me to break in to the house
which my character doesn't want to get involved with.. it gets old fast, and that's not an isolated "quest".
If it's supposed to represent things your character knows about, and not actively doing, then keep it to dialog options for a small set of appropriate characters. I don't need to see it every time I'm looking over what quests I actually want to do.
And there's something to be said about cleanliness and efficiency. If more than half the entries in some list are junk that you never want to ever bother with, there's absolutely no good reason to keep them there. There's no good reason to put it there in the first place either, if you know ahead of time you won't ever do it.