After finishing the quests "The Forsworn Conspiracy" and "No One Escapes Cidhna Mine" The guards are glitched for me in Markarth. When I'm in the hold or the city a guard will run up to me and says I'm part of the conspiracy from the previous quests.

The dialogue options I get are

I didn't do it- Pointless option.
Take me in- Guard tells me I will got to Cidhna mine, restarts conversation.
Attack- only option I can use.

I have a bounty of 30,000 and I have to kill every guard in the city to stay there without any problems.

One of my friends who also plays on the 360 encountered the same glitch, Is there anyone else with this problem?