The investigators sorted experimental philosophy studies into three types:
- Content-Based Studies: “participants receive hypothetical cases that differ in some systematic way.” (Represented by circles on the graph below.)
- Individual difference studies: “all participants receive the same case, but the researchers observe a difference between the way different types of participants respond to it.” (Represented by triangles on the graph below.)
- Context-based studies: “all participants receive the same question, but the experiment manipulates some other factor in the situation that might impact people’s answers.” (Represented by squares on the graph below.)
The investigators write:
As you can easily see [on the following graph], the majority of experimental philosophy studies are content-based, and these studies show very high rates of replicability. A minority are either individual difference studies or context-based studies, and studies of these other types often fail to replicate.
Further details, including links to the full replication information for each of the listed papers, is here.
(via Jonathan Phillips)