

I think that you make some good points. But I take issue with your third point. People lie about things to researchers (or simply don’t know have some sort of self-knowledge) all the time. This is the whole concept of “revealed preference” in economics. Someone can say that they care about sweatshop labor, but do they actually make any effort to avoid buying products produced in sweatshops?
Not questioning the experiment subjects’ stated sexual identity just neuters the whole point of the study: is homophobia driven by repressed homosexual desire. If it is repressed, we should expect subjects to say they are straight even if they aren’t. Could the methodology be flawed? Sure! But there is nothing wrong with trying to actually measure the homosexual attraction of someone who says they are not so attracted.
I definitely agree with you on all counts there. A single underpowered study does not sound science make, even disregarding the authors’ potential biases.