I'm not sure it's as simple as saying it's differences between men and women, some people (huge musical artists who aren't often told no) are far more sure of their own opinions.
I'm not defending him, think he shouldn't have said anything - just questioned your assertion that you have to have absolute empirical knowledge of something to believe it. Maybe he heard it from someone in the industry whose opinion he trusts. Once again though I don't get why people, most of all Taylor Swift, are so rattled by what ageing britpop singer Damon Albarn has to say. He's irrelevant.