I have noticed that when you're overencumbered, try using your bow and drawing and holding an arrow.
You will move a good deal faster despite being overencumbered.
Useful for getting out of that cave quicker with all that sweet sweet loot