This link has a few empty houses with safe containers http://www.uesp.net/wiki/Skyrim:Houses#Free_Shacks you can also move in with your spouse if you marry i think they should have a few also as always with that site watch out for spoilers.
If you've done the Theive's Guild questline, you get the Goldenglow Estate after finishing a certain quest. It supposedly has safe storage, and it's out side Riften.
This link has a few empty houses with safe containers http://www.uesp.net/wiki/Skyrim:Houses#Free_Shacks you can also move in with your spouse if you marry i think they should have a few also as always with that site watch out for spoilers.
I was poking around in the Thalmor HQ the other day. I will need to fire that place up in the CK and check, but none of the containers in there should respawn.
BTW, this is in Solitude in the Castle, not the Palace.