Heh, I loved that when it happened to me.
I was also confused why I could not wield, until I remembered you can only surrender to guards.
Since I didn't see any guards in the small village I traveled to Whiterun (I think) and there I could pay a fine to the guards.
After that, everyone was all happy to see me again in the village
