Over the long game, yes, it's worth it. I'm lvl 42; I just reloaded and checked the chest a few times, and it tends to contain at least a couple of endgame quality potions (Blacksmith's elixir and the like) plus some other stuff that's worth decent coin if nothing else.
If you're not running the fortify enchant/alchemy/resto loop, those are good potions. And they're FREE. All you have to do is let the chest refresh, bring the key, and grab 'em.
