Very well. The opinion of everyone is clearly to the opposite of my own.
You weren't giving an opinion, though, You were making a claim about the morality of the issue (as Z to Debunk said). Namely: "It's unfair."
It's not a case of people having different opinions - people are giving you reasons and arguments as to why you're wrong to see this in moral terms, and to think it's unfair.
Reverting to "well,t hat's your opinion" is a little weak, in the current context.