, there's a broken sword blade and handle at the base of it.. Is there any purpose to this?

I don't think so. I came across a shrine of talos in the wilderness and it had a broken axe and a steel ingot next to it, but I'm fairly sure things like this are just for display.

i think its just for show ive found a broken handle in another ruin aswell