Is one faction any easier to defeat than the other? I have been staying out of the conflict, but think it is time to make a decision. Can the conflict be resolved diplomatically, or must there be battle?
I'm not sure which you find harder, bandits or ice wraiths. Other than that, the quests are relatively the same difficulty.
You can get a temporary truce if you do the main quest, but it isn't permanent.