So you were caught, went to jail, then escaped? Do you have a save from before that you are thinking of re-loading to or something?
I can tell you that I went through that whole quest line and those corrupt guards are STILL at the freaking Talos Shrine (some odd game time months later).
What I think you have to do is kill the guards in the shrine, because if you refuse they attack. Then you have to break into the jail to talk to the boss man.
This is just my understanding of the alternative. In the end the Forsworn Leader has to take the fall for all the murders and not you, so talking to anyone but him doesn't make a lot of sense. Someone else might be able to give you a more straight forward answer...