Don't forget the the supporters of the Imperial Legion are sometimes irresponsible and corrupt people. For example, if the Legion controls Riften, Maven Black-Briar becomes Jarl which if you are a do-gooder is bad by itself. But even if you don't help the Legion, some of their supporters are already corrupt. Take the Battle-borns who act all insultingly to the Grey-manes even though the grey-manes are one of the nicest people in Whiterun and the Battle-borns hate you if you don't support them. Not to mention they mock a grey-mane who lost her son even though they know
Spoiler that he was taken to be tortured and killed by Thalmor
Even then, Jarls like the one in Falkreath are Legion supporters and are terrible. While the last Jarl of Falkreath may be paranoid, he seems to care about the town and people. The Legion supporting Jarl is terrible. He doesn't do any work, asks you to do things like bring him beer just because he is spoiled, he apparently made deals with bandits, and is lazy since he lets his steward do all the work and even tells you "You should be a Jarl. It's so easy since you don't have to do anything but get so much good stuff." While the Stormcloaks have some bad apples, at least most of their Jarls try to look out for the people.