Well yeah, you don’t care about either side of the issue, you just care about inclusivity. The meme is making a point that most people that make these comments aren’t caring because they actually care about both sports (which would be the opposite of your situation), but because they are just bigots.