Here are a few must have mods to make horse ownership worthwhile
http://www.skyrimnexus.com/downloads/file.php?id=1522 Cowardly Horses, Horse will no longer aggro and will run off a bit and stay put. Also has side options to make your horse essential as well
I love this mod. Allows me to take Frost along. I like the way horses move and turn, and the idle animations for them. I like that they allow me to get back to town after overburdening myself with dungeon loot.
I was dismayed at the 3rd-person-only limitation and the fact that while I can have a torch while riding, it idiotically sits in my crotch burning my bits and pieces to cinders. How did they manage to go backwards from Oblivion??