A New Tool to Track and Analyze Philosophers’ Mentions (guest post)


Philosophers have always referred to other philosophers in their writing, but not always with citations.

Since most bibliographic tools track connections between philosophers merely by tracking who has cited whom, many such connections may be missed.

But now there’s a new way to find out about them, as Sander Verhaegh and Gregor Bös, both of Tilburg University, explain in the following guest post. It’s called edhiphy, and it’s free for you to use.


A New Tool to Track and Analyze Philosophers’ Mentions
by Sander Verhaegh and Gregor Bös

Who was the most mentioned philosopher in English philosophy journals in the 1910s—more popular than Aristotle, Kant, or Hegel? (Hint: it is not a British or an American philosopher) Who was the most mentioned female philosopher in this period? And how dominant were the logical empiricists in the first decades after World War II?

These and similar questions can now be answered.* A group of philosophers based at Tilburg University has just launched edhiphy.org, an online platform to find and analyze mentions to and from philosophers. edhiphy, an acronym for ‘Enriched Data for the History of Philosophy’, currently contains more than one million mention links extracted from over twenty thousand journal articles and can help historians to investigate philosophical discourse in different periods and journals.

 

Standard bibliometric tools link documents and authors through citations. Philosophers, however, only started using standardized citations from the 1970s onwards. edhiphy is based on the idea that philosophers have always referenced colleagues and predecessors, but sometimes only through mentioning them by name. R. M. Blake’s 1926 paper “The Paradox of Temporal Process”, for example, does not include standardized citations but mentions dozens of philosophers, including William James, Bertrand Russell, A. N. Whitehead, and Zeno (Figure 1).

Figure 1: Philosophers mentioned in the first paragraph of R. M. Blake’s “The Paradox of Temporal Process” (Journal of Philosophy, 1926).

edhiphy can be used to find articles mentioning specific (combinations of) philosophers, and to visualize mention structures in interactive maps. The database tracks mentions to and from thousands of different philosophers (Figure 2) and allows historians to generate statistics about the most-mentioned philosophers in specific periods and journals (Table 1). It can also be used to create co-mention networks—visualizations of the frequencies with which philosophers are mentioned in the same articles—to analyze the state of a debate in a particular period or journal (Figure 3). All of these searches can also be limited to articles that contain key phrases, like ‘sense data’ or ‘existentialism’.

Table 1: Top-10 most-mentioned 20th-century philosophers (df. alive in or born after 1901) in American philosophy journals by decade.

To create the database, the edhiphy team had to find a method to assign ambiguous references to the correct philosophers. When an article mentions ‘Sellars’, for example, it is often unclear whether it is a reference to Wilfrid or his father Roy Wood. edhiphy employs a variety of strategies, including data about co-mention frequencies, to predict the intended reference. At the moment, edhiphy has linked 93% of the database’s mentions to specific philosophers with an estimated precision of 82% to 91%. The team hopes to further increase the reliability of the database in the future.

Figure 2: Number of articles mentioning Susan Stebbing by year.

Currently, edhiphy contains data from twelve major British and American philosophy journals** published between 1890 and 1979. The group is working on extending the database with French and German journals and continues to add new ways of interacting with the database. The current version is now made available to a wider audience to gather user feedback and guide further development. Some of this development will concern the elimination of remaining errors. Especially common names (‘James’, ‘Moore’) or names that also occur as nouns in other contexts (‘White, ‘Church’) still contain false positives. Also ambiguities between the philosophers and non-philosophers (e.g. Gertrud Jung and C. G. Jung) can still be misinterpreted. Other names can be extracted very reliably. To be transparent about the data quality, the website displays the context for each mention. Users can log mistakes by clicking the flag (⚐) button. Flagged mentions will not be retracted automatically, nor displayed as flagged, but help the development of better mention extraction and disambiguation.

Figure 3: Co-mention network of the most-mentioned philosophers in the period 1951-1960. Nodes represent individual authors; node sizes reflect numbers of mentions, and the distance between nodes reflects how often the corresponding authors are co-mentioned in articles from this period. Complete interactive network available online.

edhiphy is created as part of the project “Exiled Empiricists: American Philosophy and the Great Intellectual Migration“, funded by the European Research Council (ERC) and the Dutch Research Council (NWO), in collaboration with JSTOR’s Data for Research service. The project is led by Sander Verhaegh and hosted by Tilburg University in the Netherlands. The underlying database was originally conceived by Eugenio Petrovich (now based at the University of Turin) and designed with the help of Fons Dewulf (now based at Hong Kong University of Science and Technology), Claudia Cristalli, Ties van Gemert, and Nina IJdens. The edhiphy database is currently developed by Gregor E. Bös, who also created the web application edhiphy.org with technical expertise from Wessel Dankers.

Further reading:

* Answers to the questions in the opening paragraph: Henri Bergson was the most mentioned philosopher of the 1910s (here), Mary Whiton Calkins was the most-mentioned female philosopher of the 1910s (see first tutorial here). One in seven philosophy articles published in the 1950s mention Carnap at least once (here).

** Analysis, Mind, Philosophical Studies, Philosophy, Philosophy and Phenomenological Research, Philosophy of Science, Proceedings of the Aristotelian Society, Synthese, The Journal of Philosophy, The Monist, The Philosophical Quarterly, The Philosophical Review

 

guest

12 Comments
Oldest
Newest Most Voted
Inline Feedbacks
View all comments
Matt L
1 year ago

This sounds neat, and I hope it can be worked out, but the Stebbing graph is an illustration of a problem, I think – given that she was born in 1885, that first “mention” can’t possibly be to her. And, given that she only started work as a philosopher in 1911/12, and seems to have first published in 1914, some of the other early “mentions” also seems a bit worriesom – unless they are “thank yous” or the like? It would be interesting to see how accurate it is, but in any case, still interesting, of course.

Gregor Bös
Reply to  Matt L
1 year ago

That is indeed the case – we currently apply four strategies to disambiguate mentions, but adding a heuristic based on birth years is high on our list.
On your question of accuracy, we have annotated a random sample of 1,000 mentions, and found 87(+-5)% of them to be parsed correctly. We know that there are still errors, which is why we added the option for users to flag mistakes – so that we can improve the disambiguation process for the updated version.

Hermias
Hermias
1 year ago

Anselm just vibing

Kyle
Kyle
Reply to  Hermias
1 year ago

It’s like he’s lost on an island or something.

Last edited 1 year ago by Kyle
Chris
Chris
Reply to  Kyle
1 year ago

a perfect island.

Brad
Brad
1 year ago

Great work, Sander, Gregor, Eugenio, and the others. I have been following Eugenio’s work for a while now. This type of work will surely enhance our understanding of the dynamics of the philosophical community, and derivatively, the dynamics of philosophical ideas. Keep up the great work!

Steve
Steve
1 year ago

This looks like a fantastic resource, and super-interesting. I appreciate no-one has the time or money to do this, but I would be interested to see similar strategies applied to more recent work. I assume there’s a lot less ‘as Kant said…’ but I’m always fascinated by the footnotes which say ‘thanks to so-and-so for raising this issue’ or the people listed in the acknowledgment section. It’s a really notable feature of philosophy that lots of solo-authored papers have received the kinds of inputs which would, in other disciplines, be considered sufficient for co-authorship. I’m not saying philosophy is wrong in its norms and the other disciplines correct, but it would be interesting to compare a list of ‘most cited’ living philosophers with a list of ‘most thanked’.

Brian Weatherson
Brian Weatherson
Reply to  Steve
1 year ago

Eugenio Petrovich (who was one of the main builders of edhiphy) has worked on this. The second half of his recent book – https://link.springer.com/book/10.1007/978-3-031-53200-9 – is an analysis of acknowledgments. It’s really interesting, and great work.

Steve
Steve
Reply to  Brian Weatherson
1 year ago

Thank you so much for this: I have just read the relevant chapter and it is fascinating!

Justin Smith-Ruiu
Justin Smith-Ruiu
1 year ago

Europe seems to be way ahead of the US in replacing thought with data-visualization, bibliometry, “distant reading”, etc., as the primary mode of engaging with philosophy. This is mostly driven by a funding system dominated by massive agencies like the ERC, which expect this sort of “deliverable” as a condition of funding. Even if the funding source had not been explicitly mentioned in the post, I would have known right away whose money was behind edhiphy (Soviet-style acronyms are another clear marker).

It wouldn’t rub me the wrong way if these endeavors were entirely elective. The problem is that, increasingly, receiving ERC funding in Europe, as well as funding from the various national agencies –NWO, ANR, etc.– is the *only* way for junior scholars to have any hope of making a career at all. And so there is now a rising generation of young philosophers who effectively take it for granted, willy-nilly, that they *must* promise to spend a good portion of their “research” time doing things like mastering whatever software is required to create these snazzy graphs, maps, and trees. I am unhappy with this situation.

Whether or not Carl Jung is a “philosopher” –I have no opinion here, I don’t think the term is easily definable, and even wrote a book trying to show as much–, I think we can agree that he’s somewhat closer to being one in a sense that, say, Plotinus, Anne Conway, or even William James would have recognized, than is the ideal philosopher-cum-software-engineer-cum-budget-manager as envisioned by the ERC. After all, Jung drew extensively on James’s work, who for his part *does* make the edhiphy cut, even though James spent much of his career doing things like exploring haunted houses and attending spiritist séances. You see already here how things get messy, upon close reading, in ways you could never begin to detect using the tools and methods the ERC favors.

Anyhow, chapeau!

Sander Verhaegh
Reply to  Justin Smith-Ruiu
1 year ago

As the PI of the project, I am probably not the most objective person to respond to some of your worries. But it may help to say a bit more about the Exiled Empiricists group and the goals of the project.
 
Edhiphy was created by a team of historians of nineteenth- and twentieth-century philosophy with a diverse range of intellectual backgrounds (pragmatism, phenomenology, HPS, analytic philosophy, and historical epistemology) and many of choices we made in building the database (selection of journals, how to disambiguate mentions, etc.) were informed by our own, qualitative research on this period. I share your worry that some bibliometric research out there is created by academics who lack the training to make historically or philosophically informed choices but we have tried to create a tool for and by historians of philosophy.  
 
The goal of our project is to better understand the American reception of logical empiricism. Edhiphy is a useful instrument to obtain a broad overview of how U.S. philosophy developed in the decades before and after the intellectual migration. But we explicitly do not view it as a tool to ‘replace’ qualitative history or close reading. In recent years, we actually spent most of our time doing archival research. We think that it is this ‘combination’ of quantitative and qualitative approaches that helps us get an as complete picture of the reception of logical empiricism as possible. We felt that it would be a waste to construct a database to just answer questions about the reception of logical empiricism, so that is why we decided to also create a website that allows other historians to use it as well.
 
Finally, your question on who to count as a ‘philosopher’. You are right, this is an important issue. Our strategy has been to be as liberal as possible. This is why we ended up with a list of 44,376 ‘philosophers’. Of course, there are limits to how liberal one can be. The more people one includes, the more difficult it will become to disambiguate mentions: we currently have 14 people named Russell and 17 people named Moore in our database.

It is true that the competition for research funding is fierce and that the demands on early career researchers are growing rapidly. Yet the point of releasing edhiphy as a website (rather than just an SQL database) is to allow historians to use quantitative tools without having to first learn to process and clean data sets, etc. We are glad that the ERC is flexible enough to support such infrastructure creation, not just the collection of data for narrower research questions.

Justin Smith-Ruiu
Justin Smith-Ruiu
Reply to  Sander Verhaegh
1 year ago

Thanks Sander, I appreciate this background. I should have stressed that as far as I can see you and your group are doing excellent work. My concern is with the larger economic situation in the academic humanities in Europe, and with the incentive structure it creates. It sounds like you, as PI, are in a position both to use this research tool whose creation you have spearheaded, and also to spend at least some of your time thinking about issues in a way that can only really be done with old-fashioned close reading. By contrast I know some recent philosophy Ph.D.s in France, and I won’t give away identifying details, who have ended up on massive postdoc projects where effectively all of their work hours are taken up with tech-assisted data-processing and visualization. They are willing to say privately that they would still very much like to be doing “real philosophy”, but the funding system pushes them into data-processing and so they learn to look eager and go along with it in their professional capacities. They don’t have any other choice! It makes me sad to see this happening. But again, it’s not that I think such tools should not exist, or that the people who succeed by great effort and determination to bring these tools into existence should not be complimented.