Friday, July 27, 2012

Social Science Research bows down to political pressure

After receiving tremendous amounts of political pressure, the academic journal Social Science Research performed an audit of the publication of the recent controversial article by sociologist Mark Regnerus.  (Here are my thoughts on the Regnerus controversy.)  The Chronicle of Higher Education had a summary write-up of the audit's findings.

The audit found that the, "peer-review process failed to identify significant, disqualifying problems" with the study on children raised in homes where one or both parents has same-sex relationships.  It found that unbiased reviewers would not have let the study slide by in its definitions of "gay parenting".

I see three problems with this audit:
  1. The study wasn't about "gay parenting".  Regnerus was actually very careful to not make it about that because of difficulties in defining what exactly that is.  The study intentionally looked at the children of parents who had engaged in same-sex sexual encounters.  This avoided a lot of tricky definitions.  So, the result of the study was that children who knew one or more of their parents had experienced a same-sex sexual encounter had a harder time growing up and faced difficulties in early adulthood.  The objection arises that this isn't representative of "gay parents".  My response, to be blunt, is "no duh".  What the study shows, and what the paper's conclusions clearly said, is that it was promiscuousness and instability that were the primary problems for the kids.  Why should that have blocked it from being published?  To be honest, it matches every single heterosexual study I've ever seen on the topic.  Kids do better in a stable home environment.
  2. Some of the reviewers were biased.  I concede that.  For those of you not familiar with the peer-review process, it is basically a group of experts who read an academic article "blind" (they don't know who the author is) to evaluate its academic merit.  Here's my problem.  How are you going to find six unbiased peer-editors for this paper?  Almost every expert in this field is biased.  In fact, apparently two of the reviewers were biased against the Regnerus position.  They still thought the paper met academic snuff, despite being less than thrilled with the results.  (My guess is that they actually read what the paper was trying to say, not what it later got interpreted to say in the media.)  This brings me to my third point.
  3. The auditor was himself biased.  The auditor is Darren E. Sherkat, a sociologist at Southern Illinois.  As is the case with Dr. Regnerus, I've met Dr. Sherkat a couple of times.  Both times, and this stuck out to me as an Evangelical Christian, we were at a reception of some sort and he went on a tirade about how stupid and bigoted Evangelical Christians were.  His own research shows glimpses of this bias.  How did a biased scholar come to audit another scholar's work for bias?   My guess is that the journal was looking for political cover.  They found an auditor with biases of his own to placate the political uproar.  (Incidentally and conveniently, Sherkat found no fault with the journal editor.)
Now, having said all this, I want to point out something that is very important.  Dr. Regnerus is biased.  He has an openly-stated view on same-sex marriage and parenting.  This is why a conservative group gave him money to fund the study.  It may very well be that the paper was influenced by his bias, as I suspect the vast majority of academic papers on this topic are biased. If you want to attack Dr. Regnerus' work, though, be fair about it.  Give him the same treatment everyone else receives and attack him on the scholarship he actually did, not on the fact that a bunch of people didn't read his work carefully enough to know what he said.

No comments:

Post a Comment