When I try to drop it or give it to my follower to carry it says it's a quest item and can not be removed from my inventory. What is it used for after the dungeon you find it in?

...its used to open the giant magical door directly in front of where you find it on the dudes corpse

I said after the dungeon...

You have to complete the quest first, then you can remove from inventory/wall mount it.