Habryka comments on Why & How to Make Progress on Diversity & Inclusion in EA - Effective Altruism Forum

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (229)

You are viewing a single comment's thread. Show more comments above.

Comment author: Habryka 26 October 2017 10:18:01PM *  22 points [-]

As a relevant piece of data:

I looked into the 4 sources you cite in your article as improving the effectiveness of diverse teams and found the following:

  • 1 didn't replicate, and the replication found the opposite effect with a much larger sample size (which you link to in your article)
  • One is a Forbes article that cites a variety of articles, two of which I looked into and didn't say at all what the Forbes article said they say, with the articles usually saying "we found no significant effects"

  • One study you cited directly found the opposite result of what you seemed to imply it does, with its results table looking like this:


And the results section of the study explicitly saying:

"whereas background diversity displayed a small negative, yet nonsignificant, relationship with innovation (.133)."

(the thing that did have a positive relation was "job-related diversity" which is very much not the kind of diversity the top-level article is talking about)

  • The only study that you cited that did seem to cite some positive effects was one with the following results table:


Which found some effects on innovation, though overall it found very mixed effects of diversity, with its conclusion stating:

"Based on the results of a series of meta-analyses, we conclude that cultural diversity in teams can be both an asset and a liability. Whether the process losses associated with cultural diversity can be minimized and the process gains be realized will ultimately depend on the team’s ability to manage the process in an effective manner, as well as on the context within which the team operates."

Comment author: Halstead 27 October 2017 10:42:20AM 16 points [-]

I find this troubling. If a small sample of the evidence cited has been misreported or is weak, this seems to cast serious doubt on the evidence cited in the rest of the piece. Also, my prior is that pointing to lots of politically amenable social psychology research is a big red flag.