Archives For Bibliometrics

Author Information: Francisco Collazo-Reyes, Centro de Investigación y de Estudios Avanzados del IPN,
Hugo García Compeán, Centro de Investigación y de Estudios Avanzados del IPN
Miguel Ángel Pérez-Angón, Centro de Investigación y de Estudios Avanzados del IPN
Jane Margaret-Russell, Universidad Nacional Autónoma de México

Collazo Reyes, Francisco; Hugo García Compeán, Miguel Ángel Pérez-Angón, Jane Margaret-Russell,. “The Nature of the Eponym.” Social Epistemology Review and Reply Collective 7, no. 6 (2018): 12-15.

The pdf of the article gives specific page references. Shortlink:

See also:

Image by Mark Hogan via Flickr / Creative Commons


We agree in general with the comments made by G. Vélez-Cuartas (2018), on our paper published recently in Social Epistemology (Collazo-Reyes, et al, 2018). He accepts the use of our methodology in the analysis of the eponym of Jerzy Plebanski and at the same time, suggests applying this methodology to search for the formation of invisible colleges or scientific networks associated with the emergence of epistemic communities.

This was not a direct goal of our work but we included some related aspects in the revised version of our manuscript that may seem somewhat distant from the ambit of the eponym: namely, intertextuality, obliteration by incorporation, scientometrics networks, invisible colleges, epistemic communities, Jerzy Plebanski and “plebanski”. All these topics are keywords to access our paper in the indexes of scientific literature. These aspects distinguish our methodology from other approaches used in almost a thousand papers that addressed the issue of eponyms, according to a recent search for this topic in Web of Science database.

Within this framework, we appreciate the author’s suggestion to extend our analysis to other subject areas since “eponym as a scientometric tool sounds good as a promising methodology”. In particular, “to induce an analysis on other areas of sociology of science and social epistemology” in order “to reach a symbolic status in a semantic community that is organized in a network of meaning” and could show “a geographical penetration of scientific institutions and global dynamics of scientific systems” (Vélez-Cuartas, 2018).

Traditionally, published work on eponymy has studied the contribution or influence of certain authors in their respective scientific disciplines through biographies, tributes, eulogies or life histories and narratives. Some of these have been published as a series of studies like “Marathon of eponyms” (Scully et al., 2012) or “The man behind the eponym” (Steffen, 2004). The post-structuralism movement mentioned in our paper (Collazo-Reyes, et al, 2018) has criticized this approach.

In scientific texts, the use of the term “plebanski”, as an eponym of the proper name of Jerzy Plebanski, corroborates the recognition given by various authors to the work developed by the Polish scientist. Acknowledgement is apparent in cognitive texts on different aspects of plebanski’s contributions and in this context; the “plebanski” term is cited as a cognitive entity macro-referenced in the framework of scientific communication (Pang, 2010).

We would like to mention two points related to future applications of our findings on the use of eponym in the Latin American scientific literature:

1) The process involved in the construction of an eponym inherently generates a macro-referential scheme that is not considered in the cognitive structure of the databases of the bibliographical indices. The operational strength of the intertextuality associated with the referential process helps to generate socio-cognitive relations and space-time flows of scientific information.

This scheme requires characterization through a relatively exhaustive search in the different variants of the bibliographical indices: references, abstracts, citations, key words, views, twitters, blogs, Facebook, etc. (WoS, Scopus, arXiv, INSPIRE, ADS/NASA, Google citation, altmetric platforms). Most of these have arisen within the domain of the traditional bibliographical databases. Therefore, there is a clear possibility to generate an eponym index to characterize the intertextual structures not associated with the known bibliographical indices.

2) We coincide with the author on the need to take a new approach to carrying out an exhaustive search of eponyms as related to the Latin American scientific community. We are interested in characterizing the geography of collaboration at different levels: local, national, regional, and international (Livingstone, 2003; Naylor, 2005). This approach has been followed in the study of the geographical origin of eponyms in relation to the dominant system of scientific communication (Shapin, 1998; Livingstone, 1995, 2003; Geographies of Science, 2010).

We made a first attempt in this direction in our study of the “plebanski” eponym in the area of mathematical physics. In this paper, we made use of the methodology involved in “geographies of science” (Livingstone, 2010; Geographies of Science, 2010; Knowledge and Space, 2016) with theoretical tools that enhance the projections made in the framework of the sociology of science, bibliometrics and science communication.

In particular, the “spatial turn” movement (Finnegan, 2008; Gunn, 2001; Frenken, 2009; Fa-ti, 2012) offers a new dimension in the development of information systems, maps and networks using an innovative methodology such as “spatial scientometrics” (Frenken et al., 2009; Flores-Vargas, et al, 2018).

The new proposal considers, in each application of an eponym, the original source of authors, institutions, journals and subject matters. Each source includes the position in the geographical distribution of scientific knowledge associated with a given discipline. This information is then referred to as “geo-reference” and the eponyms as “macro-georeferenced” entities.

In this scheme, the generation of eponyms involves the combination of the different sources for authors, institutions, journals and subject areas. The resulting network may develop new aspects of the distribution mechanism of the asymmetrical power associated with the geographies of knowledge (Geographies of Knowledge and Power, 2010).

Contact details:


Collazo-Reyes, F., H. García-Compeán, M. A. Pérez-Angón, and J. M. Russell. 2018.  “Scientific Eponyms in Latin America: The Case of Jerzy Plebanski in the Area of Mathematical Physics.” Social Epistemology 32 (1): 63-74.

Fa-ti, F. 2012. “The global turn in the history of science.” East Asian Science, Technology and Society: An International Journal 6 (2): 249-258.

Finnegan, D. A. 2008. “The spatial turn: Geographical approaches in the history of science.” Journal of the History of Biology, 41 (2): 369-388.

Flores-Vargas, X., S. H. Vitar-Sandoval, J. I. Gutiérrez-Maya, P. Collazo-Rodríguez, and F. Collazo-Reyes. 2018. “Determinants of the emergence of modern scientific knowledge in mineralogy (Mexico, 1975-1849): a geohistoriometric approach.” Scientometrics,

Frenken, K. 2009. Geography of scientific knowledge: A proximity approach. Eindhoven Centre for Innovation Studies (ECIS), working paper 10.01. wp1001.pdf. Accessed 4 June 2016.

Frenken, K., S. Hardeman, and J. Hoekman. 2009. “Spatial scientometrics: Toward a cumulative research program.” Journal of Informetrics 3 (3): 222–232.

Geographies of Science. 2010. Peter Meusburger, David N. Livingstone, Heike Jöns, Editors. London, New York; Springer Dordrecht Heidelberg, ISBN 978-90-481-8610-5 DOI 10.1007/978-90-481-8611-2.

Geographies of Knowledge and Power. 2010. Peter Meusburger, David N. Livingstone, Heike Jöns, Editors. London, New York; Springer Dordrecht Heidelberg. 347 p.  DOI 10.1007/978-90-481-8611-2.

Gunn, S. 2001. “The spatial turn: Changing history of space and place”. In: S. Gunn & R. J. Morris (Eds.), Identities in space: On tested terrains in the Western city science 1850. Aldershot: Asghate.

Knowledge and space. 2016. Peter Meusburger, David N. Livingstone, Heike Jöns, Editors. London, New York; Springer Dordrecht Heidelberg, ISBN 978-90-481-8610-5 DOI 10.1007/978-90-481-8611-2.

Livingstone, D. N. 2003. “Putting Science in Its Place: Geographies of Scientific Knowledge.” Chicago.

Livingstone, D. N. 1995. “The spaces of knowledge: Contributions towards a historical.” Geography of Science 13 (1): 5–34.

Livingstone, D. N. (2010). “Landscapes of Knowledge” In: Geographies of Science, edited by Peter Meusburger, David N. Livingstone, Heike Jöns, Editors. London, New York; Springer Dordrecht Heidelberg,

Naylor, S. 2005. “Introduction: Historical geographies of science—Places, contexts, cartographies.” British Journal for the History of Science, 38: 1–12.

Pang, Kam-yiu S. 2010. “Eponymy and life-narratives: The effect of foregrounding on proper names.” Journal of Pragmatics 42 (5): 1321-1349.

Scully, C., J. Langdon, and J. Evans. 2012. “Marathon of eponyms: 26 Zinsser-Engman-Cole syndrome (Dyskeratosis congenita).” Oral Diseases 18 (5): 522-523.

Shapin, S. 1998. “Placing the view from nowhere: Historical and sociological problems in the location of science.” Transactions of the Institute of British Geographers, New Series 23: 5–12.

Steffen, C. 2004. “The man behind the eponym – Lauren v. Ackerman and verrucous carcinoma of Ackerman.” American Journal of Dermatopathology 26 (4): 334-341. /10.1007/s11192-018-2646-5.

Veles-Cuartas, G. 2018. “Invisible Colleges 2.0: Eponymy as a Scientometric Tool.” Social Epistemology Review and Reply Collective 7 (3) 5-8.

Author Information: Christopher M. Brown, University of Tennessee, Martin,

Brown, Christopher M. “Defending Some Objections to Moti Mizrahi’s Arguments for Weak Scientism.” Social Epistemology Review and Reply Collective 7, no. 2 (2018): 1-35.

The complete pdf of the article gives specific page references. Due to the length of Brown’s article, we will be posting it in three parts. The first installment can be found here. Shortlink for part two:

Please refer to:

Image by Bruce Irschick via Flickr / Creative Commons


Problems for Mizrahi’s Argument, Given the Number and Kind of Philosophical Assumptions at Play in the Argument

In his 2017b response, Mizrahi makes some general criticisms of my strategy in criticizing Mizrahi’s Argument as well as offering particular objections to particular arguments I make in my 2017 essay with respect to Mizrahi’s Argument. In response, then, I first say a few things about Mizrahi’s general criticisms. Second, I respond to Mizrahi’s particular objections.

Mizrahi’s first general criticism of my approach is that I simply criticize Mizrahi’s Argument by proposing certain “what ifs?” (2017b, 9). His objection seems to be the following:

  1. “The question of whether scientific knowledge is superior to non-scientific [academic] knowledge is a question that can be answered empirically” (2017b, 10).
  2. “Therefore, in order to pose a serious challenge to my defense of Weak Scientism, Brown must come up with more than mere ‘what ifs’” (2017b, 10).

The argument is clearly an enthymeme. Mizrahi presumably is presupposing:

  1. If the question of whether scientific knowledge is superior to non-scientific [academic] knowledge is a question that one can answer empirically, then, in order to pose a serious challenge to my defense of Weak Scientism, Brown must come up with more than mere “what ifs” [assumption].

But why accept 27? Presumably because we are supposed to privilege empirical (I read Mizrahi’s ‘empirical’ here as ‘experimental/scientific’) evidence over non-empirical evidence. But that’s just assuming the sort of thing that is at issue when debating the truth or falsity of scientism. So Mizrahi’s response here begs the question against those who raise critical questions about Mizrahi’s Argument and Weak Scientism.

In addition, premise 25 is one of the propositions up for debate here. Mizrahi thinks Mizrahi’s Argument is a scientific argument. I disagree, for reasons stated in my 2017 article (more on this below).

A second general criticism Mizrahi raises for my critique of Mizrahi’s Argument concerns my habit of speaking about “controversial philosophical assumptions” at play in Mizrahi’s Argument. First, Mizrahi does not like my use of the word ‘assumptions’ in reference to the (implied) premises of Mizrahi’s Argument (2017b, 12; 14) since, according to Mizrahi, “an assumption is a statement that is taken to be true without justification or support.”

I just have to confess that I don’t think ‘assumption’ necessarily has this connotation. I certainly did not intend to communicate in every case I use the word ‘assumption’ in my 2017 article that Mizrahi had not supplied any justification or support for such propositions (although I do think it is the case that Mizrahi does not offer justification for some of the [implied] premises in Mizrahi’s Argument). For better or for worse (probably worse) I was thinking of ‘assumption’ as a synonym of ‘stipulation’ or ‘presupposition’ or ‘premise.’ But I will try to be more precise in what follows.

Second, Mizrahi takes me to task for calling the (implied) premises of Mizrahi’s Argument controversial, since I don’t say why they are controversial and, as Mizrahi states with respect to his 2017a, “the way I have characterized knowledge is exactly the way others in the scientism debate understand knowledge (see, e.g., Peels 2016, 2462), which means that my characterization of knowledge is not controversial as far as the scientism debate in philosophy is concerned” (2017b, 13; see also 14-15).  In addition, by calling a premise ‘controversial’, Mizrahi takes me to mean that I am saying it is doubtful (2017b, 14-15), which, if true, would raise some puzzles for my own responses to Mizrahi 2017a.

In response, my comment in 2017 that the (implied) premises in Mizrahi’s Argument are controversial was neither intended as commentary on a narrow philosophical discussion—what Mizrahi calls “the scientism debate in philosophy” (2017b, 13; emphasis mine)—nor meant simply to point out that it is possible to doubt those premises (Mizrahi 2017b, 14-15). Rather, what I intended to say (and should have made clearer) is that the (implied) premises of Mizrahi’s Argument are controversial when we contrast them with the views of a number of different philosophical schools of thought.

That is to say, I meant to suggest that a healthy minority of contemporary philosophers will reject those premises, and have reasons for rejecting them, where that healthy minority consists (just to name a few schools of thought that have contemporary adherents) of some Platonists, Aristotelians, neo-Aristotelians, Augustinians, Thomists, Scotists, Suarezians, Ockhamists, Cartesians, Liebnizians, Kantians, neo-Kantians of various sorts, Phenomenologists, Existentialists, Whiteheadians, as well as quite a few non-naturalist analytic philosophers.

Indeed, if we practice “the democracy of the dead,” as G. K. Chesterton suggested is only fair,[1] the majority of philosophers in the past would reject the implied premises in Mizrahi’s Argument; or, if that’s a bit anachronistic, they would reject premises at least analogous to those in Mizrahi’s Argument insofar as they would not reduce philosophical knowledge to what professional philosophers make public; think of, to take just one example, Plato’s criticism of the professional philosophers of his day as false philosophers in the Phaedo[2] and the Republic.[3]

Of course, there are non-philosophers too, including practicing natural scientists (past and present) who (would) also reject Weak Scientism and many of the (implied) premises in Mizrahi’s Argument. One gets the impression from both 2017a and 2017b that Mizrahi does not think Mizrahi’s Argument is at all controversial. It was for these reasons and in the sense specified here that I emphasized in my 2017 response that a number of (implied) premises in Mizrahi’s Argument are, in fact, very controversial.

In addition, Mizrahi himself cites contemporary philosophers engaged in “the scientism debate in philosophy” who reject Mizrahi’s reduction of philosophy and philosophical knowledge to what philosophers publish (see, e.g., Sorrell 1994 and Haack 2017). There are other professional philosophers engaged in debates about the plausibility of scientism who reject quite a few of the premises in Mizrahi’s Argument (see, e.g., Brown 2011, the authors of some of the papers in Williams & Robinson 2015, and the work of analytic philosopher, Edward Feser, who has offered criticisms of scientism in: 2008, 83-85; 2010a; 2010b, and 2014, 9-24).

Third, Mizrahi thinks I should not call his assumptions philosophical unless I have first defined ‘philosophy’ (2017b, 13; 14), particularly since I claim that his argument is a philosophical and not a scientific argument (2017b, 9; 15). He states: “what Brown labels as ‘philosophical’ is not really philosophical, or at least he is not in a positon to claim that it is philosophical, since he does not tell us what makes something philosophical (other than being work produced by professional philosophers, which is a characterization of ‘philosophical’ that he rejects)” (2017b, 14).

I do not define the nature of philosophy in my 2017 response to Mizrahi’s 2017a. I supposed, perhaps wrongly, that such an endeavor was altogether outside the scope of the project of offering some critical comments on a philosophy paper. Of course, as Mizrahi no doubt knows, even the greatest of Greek philosophers, e.g., Socrates, Plato, and Aristotle, all think about philosophy in very different ways (for Socrates philosophy is a way of life which consists of a search for wisdom; for Plato philosophy is not only a search for wisdom but also involves the possession of wisdom, if only by way of the recollection of an other-worldly (or pre-worldly) set of experiences; Aristotle thinks philosophy is said in many ways (hence metaphysics is ‘first philosophy’), but pace Plato, successful philosophy, Aristotle thinks, needs to make sense of what we know by common sense).

St. Augustine has yet a different way of thinking about the nature of philosophy (philosophy is the search for wisdom, but such a search need not be limited to a mere human investigation, as with the Greeks; it may be that wisdom can be found in a rational reception of a divine revelation). By the time we get to the twentieth century there is also the great divide between analytic and continental approaches to philosophy. As Mizrahi points out, philosophers today disagree with one another about the nature of philosophy (2017a, 356).

So I could give an account of how I understand the philosophical enterprise, but that account itself would be controversial, and beside the point.[4] Perhaps, if only for dialectical purposes, we can give the following as a sufficient condition for pieces of writing and discourse that count as philosophy (N.B. philosophy, not good philosophy):

(P) Those articles published in philosophical journals and what academics with a Ph.D. in philosophy teach in courses at public universities with titles such as Introduction to Philosophy, Metaphysics, Epistemology, Normative Ethics, and Philosophy of Science.

Whereas Mizrahi takes the reduction of philosophy to what professional philosophers publish in academic journals as a premise in Mizrahi’s Argument, I don’t take P to be a necessary condition for something’s counting as philosophy. For philosophical discourses are also recorded, for example, in old books, some of which are not typically taught in philosophy courses today, and (some very good) philosophy, productive of philosophical knowledge, also occurs in conversations between persons who can directly see and hear one another. Indeed, some persons who do not have a Ph.D. in philosophy do (good) philosophy too.

First Controversial Philosophical Premise in Mizrahi’s Argument

Having remarked on Mizrahi’s general criticisms of my objections to Mizrahi’s Argument, I now turn to addressing Mizrahi’s objections to the particular objections or points I make in my critique of Mizrahi’s Argument in 2017. I address these objections not in the order Mizrahi raises them in 2017b, but as these objections track with the objections I raise in my 2017 article, and in the order I raise them (Mizrahi does not comment upon what I call ‘the Second Assumption’ at play in Mizrahi’s Argument in his 2017b, and so I say nothing else about it here).

Recall that the general schema for Mizrahi’s Argument is the following:

  1. One kind of knowledge is better than another quantitatively or qualitatively [assumption].
    8. Scientific knowledge is quantitatively better than non-scientific knowledge (including philosophical knowledge) in terms of the number of journal articles published and the number of journal articles cited.
    9. Scientific knowledge is qualitatively better than non-scientific knowledge (including philosophical knowledge) insofar as scientific theories are more successful than non-scientific theories (including philosophical theories) where the success of a theory is understood in terms of its explanatory, instrumental, and predictive success.
    10. Therefore, scientific knowledge is better than non-scientific forms of knowledge (including philosophical knowledge) both quantitatively and qualitatively [from 8 and 9].
    11. Therefore, scientific knowledge is better than non-scientific forms of knowledge (including philosophical knowledge) [from 7 and 10].

A first controversial philosophical premise at play in Mizrahi’s Argument is a premise Mizrahi uses to defend premise 8 of Mizrahi’s Argument. The premise states that we should think about both knowledge and philosophy operationally. As I point out in 2017, Mizrahi needs to premise such accounts of knowledge and philosophy, since otherwise “it won’t be possible for him to measure the quantity of knowledge in scientific and non-scientific disciplines, something Mizrahi needs to do in order to make his argument for 8” (2017, 44).

Mizrahi has three criticisms of my comment here. First, Mizrahi claims to have provided sufficient justification for operationalizing the nature of philosophy and (philosophical) knowledge by noting the controversy surrounding the nature of philosophy. In light of such controversy, citing Lauer, Mizrahi says: “Arguably, as far as answering the question ‘What makes X philosophical?’ goes, [operationalizing philosophy as what professional philosophers do] may be the best we can do (Lauer 1989, 16)” (Mizrahi 2017a, 356; Mizrahi 2017b, 12). So, contrary to what I say (or imply), Mizrahi does not simply assume we should operationalize the nature of philosophy or knowledge. Second, Mizrahi thinks it problematic for me to challenge his premise reducing philosophy to what professional philosophers do without offering my own account of the nature of philosophy (2017b, 13). Third, Mizrahi thinks it strange that a philosopher (presumably, like me) who wants to defend the usefulness of philosophy should criticize his pragmatic account of the nature of philosophy.

As to Mizrahi’s first point, he offers justification for operationalizing the nature of philosophy and knowledge only in the sense of “here’s a reason why I am proceeding in the way that I am.” Indeed, as I point out in 2017, unless he operationalizes the nature of philosophy and knowledge, “it won’t be possible for him to measure the quantity of knowledge in scientific and non-scientific disciplines, something Mizrahi needs to do in order to make his argument for 8” (2017, 44).

Of course, Mizrahi is free to stipulate an understanding of philosophy or knowledge that can be measured empirically (it’s a free country). But insofar as one bemoans the current state of the research university as one obsessed with outcomes, and measuring outcomes empirically, Mizrahi will forgive those who think stipulating an understanding of the nature of philosophy and knowledge as operational is not only shallow insofar as philosophy and knowledge can’t fit into the narrow parameters of another empirical study, but furthermore, begs the question against those who think that, as great as experimental science and its methods are, experimental science does not constitute the only disciplined approach to searching for knowledge and understanding.

Mizrahi even goes so far to say (his way of) operationalizing the nature of knowledge and philosophy is the least controversial way of doing so (2017b, 13). It’s hard to understand why he thinks that is the case. Just citing the fact that philosophers disagree with one another about the nature of philosophy, citing one author who thinks this is the best we can do, and then adding an additional account of what philosophy is to the already large list of different accounts of what philosophy is—for after all, to say philosophy is what philosophers do, is itself to do some philosophy, i.e., metaphilosophy—does not warrant thinking (a way of) operationalizing of philosophy and knowledge is the least controversial way of thinking about philosophy and knowledge.

In addition, many philosophers think it is false that philosophy and philosophical knowledge are reducible to what professional philosophers do (it may be good to recall that Socrates, Plato, Augustine, Descartes, Locke, and Hume were not professional philosophers). Also, some philosophers think that not all professional philosophers are true philosophers (again, for precedent, see the arguments in Plato’s Phaedo and Republic). Still other philosophers will insist on a definition of knowledge such as, knowledge is warranted true belief, and also think much of what is argued in philosophy journals—and perhaps science journals too—does not meet the threshold of being warranted, and so of knowledge.

Perhaps Mizrahi means (his way of) operationalizing philosophy and knowledge are the least controversial ways of thinking about philosophy and knowledge among those engaged in “the scientism debate in philosophy” (2017b, 13). That may be so. In my original response—and in this response too—I’m trying to suggest that there are people interested in evaluating scientism that do not share the scientistic account of philosophy and knowledge of those engaged in “the scientism debate in philosophy.”

Having said something above why I did not describe the nature of philosophy in my 2017, I turn to Mizrahi’s puzzlement at my raising the possibility that we should not operationalize the nature of philosophy and knowledge, given my interest in showing that philosophy is useful. After all, if it may be the case that a published journal article in philosophy does not constitute philosophy or an item of philosophical knowledge, what hope can there be to for responding to those academics who think philosophy is dead or useless?

Mizrahi apparently puts me in the class of folk who want to defend philosophy as useful. Mizrahi also seems to assume the only way to show philosophy is useful is by defining philosophy operationally (2017b, 13). Therefore, it doesn’t make sense for me to be skeptical about operationalizing the nature of philosophy and knowledge.

Is philosophy useful? That depends upon what we mean by ‘useful.’ Philosophy won’t help us cure cancer or develop the next form of modern technology (not directly, at any rate).[5] So it is not useful as physics, chemistry, biology, or mathematics are useful. It is presumably in that technological sense of ‘useful’ that Martin Heidegger says, “It is entirely proper and perfectly as it should be: philosophy is of no use” (Einfuhrung in die Metaphysik; qtd. in Pieper 1992, 41).

But by ‘useful,’ we may mean, “able to help a person live a better life.” In my view, philosophy can be very useful in that sense. A philosopher can help persons live a better life—sometimes even herself—by writing journal articles (that is, there certainly are some excellent philosophy journal articles, and some—often far too few—read and profit from these). But more often than not, since most people who may profit from exposure to philosophy or a philosopher don’t read academic journals (and wouldn’t profit much from doing so, if they did), people’s lives are improved in the relevant sense by philosophy or philosophers insofar as they encounter a good philosopher in the classroom and in every day conversations or by reading classical philosophical works from the ancient, medieval, modern, and contemporary periods.

By operationalizing the nature of philosophy and knowledge, Mizrahi’s Argument fails to account for those occasions, times, and places where most persons exposed to philosophy can—and sometimes do—profit from the experience by gaining knowledge they did not possess before about what makes for a flourishing human life.

A Third Controversial Philosophical Premise in Mizrahi’s Argument

In my 2017 article, I mention a third controversial philosophical premise at play in Mizrahi’s Argument: the view that the knowledge of each academic discipline—in terms of both its output and impact—can be quantitatively measured. Mizrahi objects that I do not “tell us what makes this alleged ‘assumption’ philosophical” (2017b, 13). He also states that I do not provide evidence that it is controversial. Finally, Mizrahi claims:

that we can measure the research output of academic fields is not “contentious” [Brown 2017, 45] at all. This so-called “assumption” is accepted by many researchers across disciplines, including philosophy [see, e.g., Kreuzman 2001 and Morrow & Sula 2011], and it has led to fruitful work in library and information science, bibliometrics, scientometrics, data science [Andres 2009], and philosophy [see, e.g., Wray & Bornmann 2015 and Ashton & Mizrahi 2017] (Mizrahi 2017b, 13).

As for my claim that the premise one can quantify over knowledge produced in academic disciplines is a philosophical premise, I assumed in my 2017 essay that Mizrahi and I were working from common ground here, since Mizrahi states, “it might be objected that the inductive generalizations outlined above [in defense of premise 8 of Mizrahi’s Argument] are not scientific arguments that produce scientific knowledge because they ultimately rest on philosophical assumptions. One philosophical assumption that they ultimately rest on, for example, is the assumption that academic knowledge produced by academic disciplines can be measured” (2017a, 356; emphasis mine).

I supposed Mizrahi to agree with the highlighted portion of the citation above, but it may be that Mizrahi was simply writing in the voice of an objector to his own view (of course, even then, we often agree with some of the premises in an objector’s argument). I also (wrongly) took it to be obvious that the premise in question is a philosophical premise. What else would it be? A piece of common sense? A statement confirmed by experimental science?[6] Something divinely revealed from heaven?

Mizrahi also claims I don’t provide evidence that the claim that we can quantify over how much knowledge is produced in the academy is controversial. What sort of evidence is Mizrahi looking for? That some philosophical paper says so? Surely Mizrahi does not think we can settle a scholarly—let alone a philosophical—dispute by simply making an appeal to an authority. Does Mizrahi think we need sociological evidence to settle our dispute? Is that the best way to provide evidence for a claim? If the answer to either of these last two questions is ‘yes’, then Mizrahi’s Argument for Weak Scientism is begging the question at issue.

But, in any case, I do offer philosophical evidence that the philosophical claim that academic knowledge can be quantitatively measured is controversial in my 2017 article:

in order to measure the amount of scientific and non-scientific, academic knowledge—as Mizrahi needs to do in order to make his argument for premise 8 [of Mizrahi’s Argument]—he needs to define knowledge teleologically—as the goal or aim of an academic discipline—or operationally—as what academics produce. But thinking about the nature of (academic) knowledge in that pragmatic way is philosophically controversial. Therefore, thinking we can measure quantitatively the amount of knowledge across academic disciplines is itself philosophically controversial, since the latter assumption only makes sense on a pragmatic account of knowledge, which is itself a controversial philosophical assumption (2017, 45).

As I noted above, by ‘controversial’ here, I mean there is (at least) a large minority of philosophers, whether we simply count professional philosophers alive today, or also include dead philosophers, who (would) reject the claims that we can collectively quantify over what counts as knowledge, knowledge is teleological, only academics produce philosophical knowledge, and philosophical knowledge is what philosophers publish in academic journals.

Finally, note that Mizrahi’s evidence that (a) reducing what academics know to what can be quantitatively measured is not controversial is that (b) there are academics from across the disciplines, including philosophy, who accept the premise that we can quantify over knowledge produced by academics and (c) the premise that we can quantify over knowledge produced by academic disciplines has led to fruitful work in a number of disciplines, including information science.

But (a)’s itself being controversial (i.e., that a large minority reject it), even false, is consistent with the truth of both (b) and (c). By analogy, it is no doubt also true that (d) academics from across the disciplines, even some philosophers, think quantitative assessment of college teaching is a good idea and (e) much data has been collected from quantitative assessments of college teaching which will be very useful for those seeking doctorates in education. But surely Mizrahi knows that (d) is controversial among academics, even if (e) is true. Mizrahi’s argument that (a) is true on the basis of (b) and (c) is a non-sequitur.

A Fourth Controversial Philosophical Premise

In my 2017 article, I claim that a fourth controversial philosophical premise is doing important work for Mizrahi’s Argument. This premise states: the quantity of knowledge of each academic discipline—in terms of both output and impact—can be accurately measured by looking at the publications of participants within that discipline. I argue that reducing the production of academic knowledge to what academics publish shows a decided bias in favor of the philosophy of education dominating the contemporary research university, in contrast to the traditional liberal arts model that places a high value on reading and teaching classic texts in philosophy, mathematics, history (including the history of science), and literature. Showing such favor is significant for two reasons.

First, it is question-begging insofar as the philosophy of education in modern research universities, prizing as it does the sort of knowledge that the methods of the experimental sciences are specially designed to produce, i.e., new knowledge and discoveries, is itself rooted in a kind of cultural scientism, one that is supported by big business, university administrators, many journalists, most politicians, and, of course, the research scientists and academics complicit in this scientistic way of thinking about the university.[7] Second, since academics produce knowledge in ways other than publishing, e.g., by way of reading, teaching, mentoring, giving lectures, and engaging others in conversation, the premise that the quantity of knowledge of each academic discipline can be accurately measured by output and impact of publications does not “present us with a representative sample of knowledge produced within all academic disciplines” (Brown 2017, 46). That means that Mizrahi’s inference to the conclusion scientists produce more knowledge that non-scientific academics from the premise, scientists produce more publications than non-scientific academics and scientists produce publications that are cited more often that those published by non-scientist academics is logically invalid.

Mizrahi responds to my comments in this context by stating that I am confusing “passing on knowledge” or “sharing knowledge” with “producing knowledge” (2017b, 14). This distinction is significant, thinks Mizrahi, since “as far as the scientism debate is concerned, and the charge that philosophy is useless, the question is whether the methodologies of the sciences are superior to those of other fields in terms of producing knowledge, not in terms of sharing knowledge” (2017b, 14). Finally, Mizrahi also notes that those in the humanities do not corner the market on activities such as teaching, for scientists pass on knowledge by way of teaching too.

Mizrahi seems to assume that sharing knowledge is not a form of producing knowledge. But I would have thought that, if a person S does not know p at time t and S comes to know p at t+1, then that counts as an instance of the production of knowledge, even if some person other than S knows p at t or some time before t or S comes to know p by way of being taught by a person who already knows p. But say, if only for the sake of argument, that Mizrahi is correct to think sharing knowledge does not entail the producing of knowledge. The fact that either Mizrahi does not count passing on or sharing knowledge as a kind of producing of knowledge or Mizrahi’s Argument does not measure the sharing or passing on of knowledge would seem to mean that Mizrahi’s Argument simply measures the production of new knowledge or discoveries, where new knowledge or a discovery can be defined as follows:

(N) New knowledge or discovery =df some human persons come to know p at time t, where no human person or persons knew p before t.

Mizrahi’s focus on knowledge as new knowledge or discovery in Mizrahi’s Argument reinforces a real limitation of (that argument for) Weak Scientism insofar as it equates knowledge with new knowledge. But it also confirms what I said in my 2017 article: Mizrahi’s Argument is question-begging since it has as a premise that knowledge is to be understood as equivalent to the sort of knowledge which the methods of the experimental sciences are specially designed to produce, i.e., new knowledge and discoveries.

Surely philosophers sometimes make new discoveries, or collectively (believe they) make progress, but philosophy (in the view of some philosophers) is more about individual intellectual progress rather than collective intellectual progress (of course, we may think it is also has the power to bring about social progress, but some of us have our real doubts about that). As Josef Pieper says:

‘Progress’ in the philosophical realm is assuredly a problematic category—insofar as it means an ever growing collective accumulation of knowledge, growing in the same measure as time passes. There exists, under this aspect, an analogy to poetry. Has Goethe ‘progressed’ farther than Homer?—one cannot ask such a question. Philosophical progress undeniably occurs, yet not so much in the succession of generations as rather in the personal and dynamic existence of the philosopher himself (1992, 92).

To the charge that scientists teach students too, I, of course, concur. But if passing on knowledge by way of teaching, mentoring, giving lectures, and personal conversations count as ways of producing knowledge, then Mizrahi’s defense of premise 8 of Mizrahi’s Argument does not, as I say in my 2017 article, “present us with a representative sample of knowledge produced within all academic disciplines” (2017, 46). And if passing on knowledge by way of teaching or reading does not count as a way of producing knowledge, then, given what many of us take to be the real intellectual significance of passing on knowledge through teaching and reading, the position Mizrahi is actually defending in 2017a and 2017b is even weaker:

(Very, Very, Very, Very Weak Scientism): When it comes to the knowledge that is produced by academic journals, i.e., the N knowledge or discoveries published in academic journals, knowledge that comes from scientific academic journals is the best.

A Fifth Controversial Philosophical Premise

Although Mizrahi says nothing about it in his 2017b response to my 2017 essay, I think it is important to emphasize again that, in arguing that scientific knowledge is better than non-scientific knowledge in terms of quantity of knowledge, Mizrahi makes use of a fifth controversial philosophical premise in Mizrahi’s Argument: the quantity of knowledge—in terms of output and impact—of each academic discipline can be successfully measured by looking simply at the journal articles published (output) and cited (impact) within that discipline. For to count only journal articles when quantifying over impact of the knowledge of a discipline is, again, to adopt a scientific, discovery-oriented, approach to thinking about the nature of knowledge.

For how often do the works of Plato, Aristotle, Virgil, St. Augustine, St. Thomas Aquinas, Dante, Shakespeare, Descartes, Hume, Kant, Hegel, Marx, and Dostoevsky, just for starters, continue to have research impact on the work of historians, social scientists, theologians, and literature professors, not to mention, philosophers? So Mizrahi’s Argument either begs the question against non-scientist academics for another reason—it neglects to count citations of great thinkers from the past—or, by focusing only on the citation of journal articles, we are given yet another reason to think the sample Mizrahi uses to make his inductive generalization in defense of premise 8 of Mizrahi’s Argument is simply not a representative one.

The Sixth and Ninth Controversial Philosophical Premises

Here I address the following controversial philosophical premises, both of which function as key background assumptions in Mizrahi’s Argument:

(K1) For any two pieces of knowledge, p and q, where p and q are produced by an academic discipline or disciplines, p is to be treated as qualitatively equal to q where measuring the quantity of knowledge produced within academic disciplines is concerned.

(K2) For any two pieces of knowledge, p and q, where p and q are produced by an academic discipline or disciplines, p is to be treated as qualitatively equal to q in the sense of the nobility or importance or perfection of p and q where measuring the quality of p and q, where quality in this latter sense measures the extent to which the theories employed in an academic discipline or discipline productive ofand q enjoy some degree of explanatory, instrumental, and predictive success.

Premise 8 of Mizrahi’s Argument says that scientific knowledge is quantitatively better than non-scientific academic knowledge because scientists publish more journal articles than non-scientists and the journal articles published by scientists are cited more often—and so have a greater “research impact”—than do the journal articles published by non-scientists (2017a, 355-58). In my 2017 essay I note that, in concluding to premise 8 on the basis of his inductive generalizations, Mizrahi is assuming (something such as) K1.

Furthermore, we may reasonably think K1 is false since the production of some sorts of non-scientific knowledge work may be harder than the production of scientific knowledge (and if a piece of work W is harder to publish than a piece of work W1, then, all other things being equal, W is qualitatively better than W1). For example, I mentioned the recent essay by philosopher David Papineau: “Is Philosophy Simply Harder than Science?” (2017). I also offered up as a reason for questioning whether K1 is correct Aristotle’s famous epistemological-axiological thesis that a little knowledge about the noblest things is more desirable than a lot of knowledge about less noble things.[8]

Premise 9 of Mizrahi’s Argument says that scientific knowledge is qualitatively better than non-scientific academic knowledge insofar as scientific theories are more successful than non-scientific theories (including philosophical theories) where the success of a theory is understood in terms of its explanatory, instrumental, and predictive success. In my 2017 response, I suggest that Mizrahi has (something such as) K2 implicitly premised as a background philosophical assumption in his argument for premise 9, and a premise such as K2 is a philosophically controversial one. At the very least, Mizrahi’s implicitly premising K2 in Mizrahi’s Argument therefore limits the audience for which Mizrahi’s Argument will be at all rhetorically convincing. For as I stated in my 2017 response:

Assume . . .  the following Aristotelian epistemological axiom: less certain knowledge (or less explanatorily successful knowledge or less instrumentally successful knowledge or less testable knowledge) about a nobler subject, e.g., God or human persons, is, all other things being equal, more valuable than more certain knowledge (or more explanatorily successful knowledge or more instrumentally successful knowledge or more testable knowledge) about a less noble subject, e.g., stars or starfish. . . . [And] consider, then, a piece of philosophical knowledge P and a piece of scientific knowledge S, where P constitutes knowledge of a nobler subject than S. If S enjoys greater explanatory power and more instrumental success and greater testability when compared to P, it won’t follow that S is qualitatively better than P (2017, 50).

Mizrahi raises a number of objections to the sections of my 2017 essay where I mention implicit premises at work in Mizrahi’s Argument such as K1 and K2. First, I don’t explain why, following Papineau, philosophy may be harder than science (2017b, 9). Second, he offers some reasons to think Papineau is wrong: “producing scientific knowledge typically takes more time, effort, money, people, and resources . . . [therefore], scientific knowledge is harder to produce than non-scientific knowledge” (2017b, 9). Third, he notes I don’t argue for Aristotle’s epistemological-axiological thesis, let alone explain what it means for one item of knowledge to be nobler than another.

Fourth, in response to my notion that philosophy and science use different methodologies insofar as the methods of the former do not invite consensus whereas the methods of the latter do, Mizrahi notes that “many philosophers would probably disagree with that, for they see the lack of consensus, and thus progress in philosophy as a serious problem” (2017b, 10). Fifth, Mizrahi thinks there is precedent for his employing a premise such as K1 in his defense of premise 8 in Mizrahi’s Argument insofar as analytic epistemologists often use variables in talking about the nature of knowledge, e.g., propositions such as ‘if person S knows p, then p is true,’ and therefore treat all instances of knowledge as qualitatively equal (2017b, 13, n. 2).

In mentioning Papineau’s article in my 2017 essay, I offer an alternative interpretation of the data that Mizrahi employs in order to defend premise 8 of Mizrahi’s Argument, an interpretation that he should—and does not—rule out in his 2017a paper, namely, that scientists produce more knowledge than non-scientists not because scientific knowledge is better than non-scientific knowledge but rather because non-scientific knowledge (such as philosophical knowledge) is harder to produce than scientific knowledge. Indeed, Mizrahi himself feels the need to rule out this possibility in his 2017b reply to my 2017 article’s raising this very point (see 2017b, 9).

Mizrahi’s inference about the greater difficulty of scientific work compared to non-scientific academic work such as philosophy goes through only if we think about the production of philosophical knowledge in the operational manner in which Mizrahi does. According to that model of philosophical knowledge, philosophical knowledge is produced whenever someone publishes a journal article. But, traditionally, philosophical knowledge is not that easy to come by. Granted, scientific knowledge too is hard to produce. As Mizrahi well notes, it takes lots of “time, effort, money, people, and resources” to produce scientific knowledge.

But we live in a time that holds science in high regard (some think, too high a regard), not just because of the success of science to produce new knowledge, but because science constantly provides us with obvious material benefits and new forms of technology and entertainment.[9] So it stands to reason that more time, effort, money, and resources are poured into scientific endeavors and more young people are attracted to careers in science than in other academic disciplines. When one adds to all of this that scientists within their fields enjoy a great consensus regarding their methods and aims, which invites greater cooperation among researchers with those fields, it is not surprising that scientists produce more knowledge than those in non-scientific academic disciplines.

But all of that is compatible with philosophy being harder than science. For, as we’ve seen, there is very little collective consensus among philosophers about the nature of philosophy and its appropriate methods. Indeed, many academics—indeed, even some philosophers—think knowledge about philosophical topics is not possible at all. It’s not beyond the pale to suggest that skepticism about the possibility of philosophical knowledge is partly a result of the modern trend towards a scientistic account of knowledge. In addition, some philosophers think philosophical knowledge is harder to acquire than scientific knowledge, if only because of the nature of those topics and questions that are properly philosophical (see Papineau 2017 and Van Inwagen 2015, 14-15).

As for the meaning of Aristotle’s epistemological-axiological claim, I take it that Aristotle thinks p is a nobler piece of knowledge than q if, all others being equal, the object of p is nobler than the object of q. For example, say we think (with Aristotle) that it is better to be a rational being than a non-rational being. It would follow that rational animals (such as human persons) are nobler than non-rational animals. Therefore, applying Aristotle’s epistemological-axiological claim, all other things being equal, knowing something about human persons—particularly qua embodied rational being—is a nobler piece of knowledge than knowing something about any non-rational object.

Now, as Mizrahi points out, not all philosophers agree with Aristotle. But my original point in mentioning Aristotle’s epistemological-axiological thesis was to highlight an implicit controversial philosophical premise in the background of Mizrahi’s Argument. The Aristotelian epistemological-axiological thesis is perhaps rejected by many, but not all, contemporary philosophers. The implicit assumption that Aristotle is wrong that (knowledge of) some object is nobler than (knowledge of) another object is a philosophical assumption (just as any arguments that Aristotle is wrong will be philosophical arguments). Indeed, it may be that any reason a philosopher will give for rejecting Aristotle’s epistemological-axiological thesis will also show that they are already committed to some form of scientistic position.

I say the practice of philosophy doesn’t invite consensus, whereas one of the advantages of an experimental method is that it does. That is a clear difference between philosophy and the experimental sciences, and since at least the time of Kant, given the advantage of a community of scholars being able to agree on most (of course, not all) first principles where some intellectual endeavor is concerned, some philosophers have suggested philosophy does not compare favorably with the experimental sciences.

So it is no surprise that, as Mizrahi notes, “many [contemporary] philosophers . . . see the lack of consensus, and thus progress in philosophy as a serious problem” (2017b, 10). But it doesn’t follow from that sociological fact, as Mizrahi seems to suggest it does (2017, 10), that those same philosophers disagree that philosophical methods don’t invite consensus. A philosopher could lament the fact that the methods of philosophy don’t invite consensus (in contrast to the methods of the experimental sciences) but agree that that is the sober truth about the nature of philosophy (some professional philosophers don’t like philosophy or have science envy; I’ve met a few). In addition, the fact that some philosophers disagree with the view that philosophical methods do not invite consensus shouldn’t be surprising. Philosophical questions are by nature controversial.[10]

Finally, Mizrahi defends his premising (something such as) K1 by citing the precedent of epistemologists who often treat all items of knowledge as qualitatively the same, for example,  when they make claims such as, ‘if S knows p, then p is true.’ But the two cases are not, in fact, parallel. For, unlike the epistemologist thinking about the nature of knowledge, Mizrahi is arguing about and comparing the value of various items of knowledge. For Mizrahi to assume KI in an argument that tries to show scientific knowledge is better than non-scientific knowledge is to beg a question against those who reasonably think philosophy is harder than science or the things that philosophers qua philosophers know are nobler than the things that scientists qua scientists know, whereas epistemologists arguably are not begging a question when engaged in the practice of abstracting from various circumstances (by employing variables) in order to determine what all instances of knowledge have in common.

The Seventh and Eighth Controversial Philosophical Premises

In his attempt to defend the thesis that scientific knowledge is qualitatively better than non-scientific knowledge, Mizrahi assumes that a theory A is qualitatively better than a theory B if A is more successful than B (2017a, 358). He thus thinks about a theory’s qualitative value in pragmatic terms. But not all philosophers think about the qualitative goodness of a theory in pragmatic terms, particularly in a philosophical context, if only because, of two theories A and B, A could be true and B false, where B is more successful than A, and a philosopher may prize truth over successful outcomes.[11] This constitutes a seventh controversial philosophical premise in Mizrahi’s Argument.

In addition, as I point out in my 2017 response, there is an eighth controversial philosophical premise in the background of Mizrahi’s Argument, namely, that a theory A is more successful than a theory B if A is more explanatorily successful than B, and more instrumentally successful than B, and more predictively successful than B. Even if we grant, for the sake of argument, that this is a helpful account of a good scientific explanation, interestingly, Mizrahi thinks these criteria for a successful scientific theory can be rightfully applied as the measure of success for a theory, simpliciter.

I argued in my 2017 response that to think philosophical theories have to be, for example, instrumentally successful (in the way experimental scientific theories are, namely, (a) are such that they can be put to work to solve immediate material problems such as the best way to treat a disease or (b) are such that they directly lead to technological innovations) and predicatively successful in an argument for the conclusion that scientific knowledge is better than non-scientific knowledge is “to beg the question against non-scientific ways of knowing, ways of knowing that do not, by their very nature, employ controlled experiments and empirical tests as an aspect of their methodologies” (2017, 48).

In responding to my comments, Mizrahi makes three points. First, I criticize his account of explanation without offering my own account of explanation (2017b, 19). Second, passing over my comments that good philosophical theories need not be instrumentally successful (in the relevant sense) or predicatively successful, Mizrahi argues that I can’t say, as I do, that good philosophical theories explain things but do not enjoy the good-making qualities of all good explanations. As Mizrahi states, “the good-making properties of [good] explanations include unification, coherence, simplicity, and testability. Contrary to what Brown (2017, 48) seems to think, these good-making properties apply to explanations in general, not just to scientific explanations in particular” (2017b, 19) and

Contrary to what Brown asserts without argument, then, ‘To think that a theory T is successful only if—or to the extent that—it enjoys predicative success or testability’ is not to beg the question against non-scientific ways of knowing. For, insofar as non-scientific ways of knowing employ IBE [i.e., inference to the best explanation], which Brown admits is the case as far as philosophy is concerned, then their explanations must be testable (as well as unified, coherent, and simple) if they are to be good explanations (Mizrahi 2017b, 2); emphases in the original).

Mizrahi offers as evidence for the claim that all good explanations are testable and enjoy predicative power the ubiquity of such a claim in introductory textbooks on logic and critical thinking, and he offers as a representative example a chapter from a textbook by two philosophers, Sinnott-Armstrong & Fogelin 2010.

I plead guilty to not offering an account of good explanation in my 2017 article (for the same sort of reason I gave above for not defining philosophy). What I contend is that just as philosophical methods are different in kind from those of the experimental scientists, so too is a good philosophical explanation different in kind from what counts as a good explanation in an empirical science. That is not to say that philosophical and scientific explanations have nothing significant in common, just as it is not to say that the practice of philosophy has nothing in common with experimental scientific practice, despite their radical differences.

For both philosophy—at least on many accounts of its nature—and experimental science are human disciplines: their premises, conclusions, theories, and proposed explanations must submit to the bar of what human reason alone can establish.[12] Indeed, many philosophers who do not share Mizrahi’s scientistic cast of mind could happily agree that good philosophical explanations are coherent and, all other things being equal, that one philosophical explanation E is better than another E1 if E is more unified or simpler or has more explanatory power or depth or modesty than E1.

Others would add (controversially, of course) that, all other things being equal, philosophical theory E is better than E1 if E makes better sense of, or is more consistent with, common-sense assumptions about reality and human life,[13] e.g., if theory E implies human persons are never morally responsible for their actions whereas E1 does not, then, all other things being equal, E1 is a better philosophical theory than theory E. In addition, we may think, taking another cue from Aristotle, that a philosophical theory E is better than a theory E1, all other things being equal, if E raises fewer philosophical puzzles than E1.

Mizrahi also premises that good philosophical explanations have to be testable (2017a, 360; 2017b, 19-20). But what does he mean? Consider the following possibilities:

(T1) A theory or explanation T is testable if and only if T can be evaluated by controlled experiments and other methods characteristic of the experimental sciences, e.g., inductive generalization.

(T2) A theory or explanation is testable if and only if T can be evaluated by (a) controlled experiments and other methods characteristic of the experimental sciences, e.g., inductive generalization or (b) on the basis of deductive arguments or (c) the method of disambiguating premises, or (d) the method of refutation by counter-example or (e) inference to the best explanation or (e) thought experiments (or (f) any number of other philosophical methods or (g) methods we use in everyday life).

In my 2017 response, I took Mizrahi to mean (something such as) T1 by ‘a good explanation is testable’. For example, Mizrahi states: “as a general rule of thumb, choose the explanation that yields independently testable predictions” (2017a, 360; emphases mine). If Mizrahi accepts T1 and thinks all good explanations must be testable, then, as I stated in my 2017 response, “philosophical theories will . . . not compare favorably with scientific ones” (2017, 49).

But as philosopher Ed Feser well points out, to compare the epistemic values of science and philosophy and fault philosophy for not being good at making testable predications is like comparing metal detectors and gardening tools and concluding gardening tools are not as good as metal detectors because gardening tools do not allow us to successfully detect for metal (2014, 23).

In other words, if T1 is what Mizrahi means by ‘testable’ and Mizrahi thinks all good explanations are testable, then Mizrahi’s Argument does, as I contend in my 2017 response, “beg the question against non-scientific ways of knowing, ways of knowing that do not, by their very nature, employ controlled experiments and empirical tests as an aspect of their methodologies” (2017, 48; see also Robinson 2015).

But perhaps Mizrahi means by ‘an explanation’s being testable’ something such as T2. But in that case, good philosophical work, whether classical or contemporary, will compare favorably with the good work done by experimental scientists (of course, whether one thinks this last statement is true will depend upon one’s philosophical perspective).

Some Concluding General Remarks About Mizrahi’s Argument

Given the number of (implied) controversial philosophical premises that function as background assumptions in Mizrahi’s Argument, that argument should not convince those who do not already hold to (a view close to) Weak Scientism. As we’ve seen, Mizrahi premises, for example, that philosophy should be operationally defined as what philosophers do, that knowledge within all academic disciplines should be operationally defined as what academics publish in academic journals, K1, K2, and all good explanations are explanatorily, instrumentally, and predicatively successful.

Of course, the number of controversial philosophical premises at play in Mizrahi’s Argument isn’t in and of itself a philosophical problem for Mizrahi’s Argument, since the same could be said for just about any philosophical argument. But one gets the distinct impression that Mizrahi thinks Mizrahi’s Argument should have very wide appeal among philosophers. If Mizrahi wants to convince those of us who don’t already share his views, he needs to do some more work defending the implied premises of Mizrahi’s Argument, or else come up with a different argument for Weak Scientism.

Indeed, many of the implied controversial philosophical premises I’ve identified in Mizrahi’s Argument are, as we’ve seen, not only doing some heavy philosophical lifting in that argument, but such premises imply that (something such as) Weak Scientism is true, e.g., the quantity of knowledge of each academic discipline—in terms of both output and impact—can be accurately measured by looking at the publications of participants within that discipline, K1, K2, a theory A is more successful than a theory B if A is more explanatorily successful than B, and more instrumentally successful than B, and more predictively successful than B, and an explanation is a good explanation only if it is testable in the sense of T1. Mizrahi’s Argument thus begs too many questions to count as a good argument for Weak Scientism.

Mizrahi is also at pains to maintain that his argument for Weak Scientism is a scientific and not a philosophical argument, and this because a significant part of his argument for Weak Scientism not only draws on scientific evidence, but employs “the structure of inductive generalization from samples, which are inferences commonly made by practicing scientists” (2017a, 356). I admit that a scientific argument from information science is “a central feature of Mizrahi’s Argument” (Brown 2017, 50) insofar as he uses scientific evidence from information science to support premise 8 of Mizrahi’s Argument. But, as I also note in my 2017 essay, “Mizrahi can’t reasonably maintain his argument is thereby a scientific one, given the number of controversial philosophical assumptions employed as background assumptions in his argument” (2017, 51).

My objection that Mizrahi’s Argument is a piece of philosophy and not a scientific argument is one that Mizrahi highlights in his response (2017b, 9). He raises two objections to my claim that Mizrahi’s Argument is a philosophical and not a scientific argument. First, he thinks I have no grounds for claiming Mizrahi’s Argument is a philosophical argument since I don’t give an account of philosophy, and I reject his operationalized account of philosophy (2017b, 15). Second, Mizrahi states that

Brown seems to think than an argument is scientific only if an audience of peers finds the premises of that argument uncontroversial. . . . Accordingly, Brown’s (2017) criterion of controversy [according to Mizrahi, I think this is dubitability] and his necessary condition for an argument being scientific have the absurd consequence that arguments presented by scientists at scientific conferences (or published in scientific journals and books) are not scientific arguments unless they are met with unquestioned acceptance by peer audiences (2017b, 16).

I have already addressed Mizrahi’s comment about the nature of philosophy above. In response to his second objection, Mizrahi wrongly equates my expression, “controversial background philosophical assumptions,” with his expression, “controversial premises in a scientific argument.” Recognizing this false equivalency is important for evaluating my original objection, and this for a number of reasons.

First, what Mizrahi calls the “premises of a scientist’s argument” (2017b, 15) are, typically, I take it, not philosophical premises or assumptions. For is Mizrahi claiming that scientists, at the presentation of a scientific paper, are asking questions about propositions such as K1 or K2?

Second, Mizrahi and I both admit that philosophical background assumptions are sometimes in play in a scientific argument. Some of these claims, e.g., that there exists an external world, some philosophers will reject. What I claimed in my 2017 essay is that a scientific argument—in contrast to a philosophical argument—employs background philosophical assumptions that “are largely non-controversial for the community to which those arguments are addressed, namely, the community of practicing scientists” (2017, 15). For example, an argument that presupposed the truth of theism (or atheism), would not be, properly speaking, a scientific argument, but, at best, a philosophical argument that draws on some scientific evidence to defend certain of its premises.

So, contrary to what Mizrahi says, my argument that Mizrahi’s Argument is not a scientific argument neither implies that Darwin’s Origin of the Species is not science, nor does it imply a scientist’s paper is not science if audience members challenge that paper’s premises, methods, findings, or conclusion. Rather, my comment stands unscathed: because of the number of philosophical background premises that are controversial among the members of the audience to which Mizrahi’s Argument is directed—presumably all academics—Mizrahi’s Argument is not a scientific argument but rather, a philosophical argument that draws on some data from information science to defend one of its crucial premises, namely premise 8.

But, as I pointed out above, even Mizrahi’s argument for premise 8 in Mizrahi’s Argument is a philosophical argument, drawing as that argument does on the controversial philosophical background premises such as philosophy should be operationally defined as what philosophers do, knowledge within all academic disciplines should be operationally defined as what academics publish in academic journals, and K1.

Finally, there is another reason why Mizrahi himself, given his own philosophical principles, should think Mizrahi’s Argument is a piece of philosophy. As we’ve seen, Mizrahi thinks that philosophy and philosophical knowledge should be defined operationally, i.e., philosophy is what philosophers do, e.g., publish articles in philosophy journals, and philosophical knowledge is what philosophers produce, i.e., publications in philosophy journals (see Mizrahi 2017a, 353). But Mizrahi’s 2017a paper is published in a philosophy journal. Therefore, by Mizrahi’s own way of understanding philosophy and science, Mizrahi’s Argument is not a scientific argument, but a philosophical argument (contrary to what Mizrahi says in both 2017a and 2017b).

Contact details:


Aquinas, Saint Thomas. Summa Theologiae. Translated by the Fathers of the English Dominican Province. Allen, TX: Christian Classics, 1981.

Aquinas, Saint Thomas. Summa Contra Gentiles. Book One. Trans. Anton C. Pegis. South Bend, IN: University of Notre Dame Press, 1991.

Aristotle. Posterior Analytics. Trans. G.R.G. Mure. In The Basic Works of Aristotle. Ed. Richard McKeon. New York: Random House, 1941.

Aristotle. On the Parts of Animals. Trans. William Ogle. In The Basic Works of Aristotle. Ed. Richard McKeon. New York: Random House, 1941.

Aristotle. Nicomachean Ethics. Trans. W.D. Ross. In The Basic Works of Aristotle. Ed. Richard McKeon. New York: Random House, 1941.

Augustine, Saint. Confessions. Trans. Frank Sheed. 1942; reprint, Indianapolis: Hackett Publishing, 2006.

Brown, Christopher. “Some Logical Problems for Scientism.” Proceedings of the American Catholic Philosophical Association 85 (2011): 189-200.

Brown, Christopher. “Some Objections to Moti Mizrahi’s ‘What’s So Bad about Scientism?’.” Social Epistemology Review and Reply Collective 6, no. 8 (2017): 42-54.

Bourget, David and David J. Chalmers. “What do philosophers believe?” Philosophical Studies 170, 3 (2014): 465-500.

Chesterton, G.K. Orthodoxy. 1908; reprint, San Francisco: Ignatius Press, 1995.

Feldman, Richard. Epistemology. Upper Saddle River, NJ: Prentice-Hall, 2003.

Feser, Edward. The Last Superstition: A Refutation of the New Atheism. South Bend: St. Augustine’s Press, 2008.

Feser, Edward. “Blinded by Scientism.” Public Discourse. March 9, 2010a. Accessed January 15, 2018.

Feser, Edward. “Recovering Sight after Scientism.” Public Discourse. March 12, 2010b. Accessed January 15, 2018.

Feser, Edward. Scholastic Metaphysics: A Contemporary Introduction. editiones scholasticae, 2014.

Haack, Susan. Defending Science—Within Reason: Between Scientism and Cynicism. Amherst, NY: Prometheus Books, 2007.

Haack, Susan. “The Real Question: Can Philosophy Be Saved? Free Inquiry (October/November 2017): 40-43.

MacIntyre, Alasdair. God, Philosophy, and Universities. Lanham: Rowman & Littlefield, 2009.

Mizrahi, Moti. “What’s So Bad About Scientism?” Social Epistemology 31, no. 4 (2017a): 351-367.

Mizrahi, Moti. “In Defense of Weak Scientism: A Reply to Brown.” Social Epistemology Review and Reply Collective 6, no. 11 (2017b): 9-22.

Oxford English Dictionary Online, s.v. “scientism,” accessed January 10, 2018,

Papineau, David. “Is Philosophy Simply Harder than Science?” The Times Literary Supplement On-line. June 1, 2017. Accessed July 11, 2017.

Pieper, Josef. In Defense of Philosophy. Trans. Lothar Krauth. 1966; reprint, San Francisco: Ignatius Press, 1992.

Plato. Phaedo. In Five Dialogues. Trans. Grube and Cooper. Indianapolis: Hackett Publishing, 2002.

Plato. Gorgias. Trans. Donald J. Zeyl. Indianapolis: Hackett Publishing, 1987.

Plato. Republic. Trans. C.D.C. Reeve. Indianapolis: Hackett Publishing, 2004.

Postman, Neil. Technopoly: the Surrender of Culture to Technology. New York: Vintage Books, 1993.

Robinson, Daniel N. “Science, Scientism, and Explanation.” In Scientism: the New Orthodoxy. Williams and Robinson, eds. London: Bloomsbury Academic, 2015, 23-40.

Rosenberg, Alex. The Atheist’s Guide to Reality. New York: W. W. Norton and Co., 2011.

Sorrell, Tom. Scientism: Philosophy and the Infatuation with Science. First edition. London: Routledge, 1994.

Sorell, Tom. Scientism: Philosophy and the Infatuation with Science. Kindle edition. London: Routledge, 2013.

Van Inwagen, Peter. Metaphysics. 4th edition. Boulder, CO: Westview Press, 2015.

Williams, Richard. N. and Daniel N. Robinson, eds. Scientism: the New Orthodoxy. London: Bloomsbury Academic, 2015.

[1] “Tradition means giving votes to the most obscure of all classes, our ancestors. It is the democracy of the dead. Tradition refuses to submit to the small and arrogant oligarchy of those who merely happen to be walking about” (Orthodoxy [chapter four] 1995, 53).

[2] See Phaedo, 61c-d and 64b-69e.

[3] See Republic 473c-480a.

[4] Here follows a description of something like one traditional way of thinking about the intellectual discipline of philosophy, one that I often give in my introduction to philosophy classes. It describes philosophy by comparing and contrasting it with the experimental sciences, on the one hand, and revealed theology, on the other hand: philosophy is that intellectual discipline which investigates the nature of ultimate reality, knowledge, and value (i.e., subjects the investigation of which raise questions that can’t be settled simply by running controlled experiments and taking quantitative measurements) by way of methods such as deductive argumentation, conceptual analysis, and reflection upon one’s own experiences and the experiences of others (where the experiences of others include, but are not limited to, the experiences of experimental scientists doing experimental science and the experiences of those who practice other intellectual disciplines), by way of the natural light of human reason alone (where this last clause is concerned, philosophy is usefully compared and contrasted with revealed theology: revealed theology and philosophy investigate many of the same questions, e.g., are there any sorts of actions that ought to never be performed, no matter what?, but whereas philosophy draws upon the natural light of human reason alone to answer its characteristic questions [in this way philosophy is like the experimental sciences], and not on any supposed divine revelations, revealed theology makes use of the natural light of reason and [what revealed theologians believe by faith is] some divine revelation).

[5] Although, as I pointed out in my 2017 essay, it seems one can plausibly argue that modern science has the history of Western philosophy as a necessary or de facto cause of its existence, and so the instrumental successes of modern science also belong to Western philosophy indirectly.

[6] For academics don’t agree on which claims count as knowledge claims, e.g., some will say we can know propositions such as murder is always wrong, others don’t think we can know ethical claims are true. Are we, then, to simply measure those claims published at the university that all—or the great majority of academics believe count as knowledge claims? But in that case, we are no longer measuring what counts as knowledge, but rather what a certain group of people, at a certain time, believes counts as knowledge. I don’t think I’m going out on a limb when I say cataloguing what a certain group of people believe is sociology and not philosophy.

[7] See, e.g., Alasdair MacIntyre 2009, esp. 15-18 and 173-180.

[8] See, e.g., On the Parts of Animals, Book I, chapter 5 [644b32-645a1]. See also St. Thomas Aquinas, Summa contra gentiles, book one, ch. 5, 5 and Summa theologiae Ia. q. 1, a. 5, ad1.

[9] Of course, modern science and technology produce negative effects too, e.g., pollution, and, according to some, increased dissolution of traditional social bonds. But, because the positive effects of modern science and technology are often immediate and the negative effects often arise only after some time has passed, it is hard for us to take into account, let alone see, the negative consequences of modern science and technology. For some helpful discussion of the history of the culturally transformative effects of modern science and technology, both positive and negative, see Postman 1993.

[10] See, e.g., Bourget & Chalmers 2014. As that study shows, when a good number of contemporary philosophers were polled about a number of major philosophical questions, every question asked turns out to be collectively controversial. Although the paper certainly identifies certain tendencies among contemporary philosophers, e.g., 72.8% identified as atheists, and only 14.6% identified as theists, that latter number is still a healthy minority view so that its seems right to say that whether atheism or theism is true is collectively controversial for contemporary philosophers. For some good discussion of philosophical questions as, by nature, controversial, see also Van Inwagen 2015, 11-19.

[11] A small point: in responding to my comment here, Mizrahi misrepresents what I say. He renders what I call in my 2017 article “the seventh assumption” as “One theory can be said to be qualitatively better than another” (2017b, 12). That’s not what I say; rather I suggest Mizrahi’s Argument premises a theory A is qualitatively better than theory B if A is more successful than theory B.

[12] In this way, philosophy and the experimental sciences differ from one historically important way of understanding the discipline of revealed theology. For example, as St. Thomas Aquinas understands the discipline of revealed theology (see, e.g., Summa theologiae Ia. q. 1.), revealed theology is that scientia that treats especially of propositions it is reasonable to believe are divinely revealed, propositions that can’t be known by the natural light of human reason alone. In addition, the wise teacher of revealed theology can (a) show it is reasonable to believe by faith that these propositions are divinely revealed and (b) use the human disciplines, especially philosophy, to show how propositions that are reasonably believed by faith are not meaningless and do not contradict propositions we know to be true by way of the human disciplines, e.g., philosophy and the sciences.

[13] See, e.g., Aristotle’s Nicomachean Ethics, book vii, ch. 1 (1145b2-7).

Author Information: Ryan D. Tweney, Bowling Green State University,

Tweney, Ryan D. “Commentary on Anderson and Feist’s ‘Transformative Science’.” Social Epistemology Review and Reply Collective 6, no. 7 (2017): 23-26.

The PDF of the article gives specific page numbers. Shortlink:

Please refer to:

Image credit: Phylogeny Figures, via flickr

Traditionally, historic transformations in science were seen as the products of “great men”; Copernicus, Newton, Darwin, or, in the modern era, Einstein and Marie Curie. It was “genius” that propelled science to new levels of achievement and understanding. Such views have fallen out of favor as the collective efforts that go into scientific advances have come to be recognized, a change in perspective often attributed to Thomas Kuhn.

“Transformative Science” is a new phrase, now used even by funding agencies as one of the criteria for worthy projects. Barrett Anderson and Gregory Feist (2017), however, note how fuzzy the term has been and offer something like a definition. Transformative science, they suggest, is science that leads to a new branch on the “tree of knowledge.”

This is not a true definition, of course, since it is based upon a metaphor, one which is itself only fuzzily defined. Anderson and Feist note that the tree metaphor has been formalized in biology via cladistics. The present paper seeks to extend something similar to the domain of research evaluation. As with cladistics, if formal tools can be developed to measure aspects relevant to the growth of knowledge in science, then it may be that we will advance toward an understanding of transformative science. They thus propose a method for measuring the influence of a given, highly-cited, paper in a way potentially leading to the goal of identifying truly transformative results.

Plotting Generativity

Anderson and Feist’s exploratory study focused upon a single year of publication (2002) from a single field (psychology), selecting randomly some 887 articles that were among the top 10% of most highly cited articles. They then looked at the articles that had cited these 887, identifying those that were themselves among the most cited. They then developed a “generativity score” for each of the original articles. In effect, among the 887 articles, they singled out those that had generated the highest numbers of highly cited articles. Each of the 887 were then examined and coded for funding source.

Descriptively, both generativity and times cited were heavily skewed (Figures 6, 140, and 8, 141), leading the authors to carry out a log transformation of each (Figures 7 and 9, 141), in an attempt to normalize the distributions. They claim that this was successful for the generativity scores, but not for the number of times cited. But note that the plots are severely misleading. Since there are 887 articles in the sample, and the number of points on each graph is far smaller, it must be the case that multiple articles are hidden within each of the plotted points. Is it the case that the vast majority of the articles are somewhere in the middle of each distribution? At the lower end? At the upper end? If so, the claim that generativity was successfully normalized is suspect. This is even apparent from the graph (Figure 7, 141) which, while roughly bell-shaped (as far as the outer “envelope” of points is concerned), clearly must have a large majority of points that share the same value. Since the mean and median of “G log 10” (see Table 4, 140) are reported as roughly equal at around 1.0, these shared points must be at the lower end of the scale (below an untransformed generativity score of 10). A better plot, with the individual points “jittered” to separate them might then make the claim of approximate normality more convincing (Cleveland 1985).

Similar considerations applied to the times cited plots suggest a different distribution, though still far from normal, whether in raw scores or log transformed scores. Is it a Poisson distribution? Clearly not, since, in a Poisson, the mean and variance should be roughly equal. This is far from the case, whether raw scores or transformed scores are used.

The nature of the distribution matters here because Pearson r was used to determine the relationship between generativity and times cited. But Pearson’s statistic is only appropriate for determining the linear relationship between two bivariate normal variables. Anderson and Feist report the correlations as r = 0.87 for G and TC and 0.69 for G log10 and TC log 10.  This strikes me as meaningless, especially if there are large numbers of low generativity points masked by the lack of jittering (as suggested above). From the similarly unjittered scatterplots (Figures 10 and 11, 142), which are superficially, more-or-less bivariate linear, the points at the lower end look to be unrelated. This suggests that a small number of points at the upper end are pulling the regression line upwards, a possibility that recalls “Anscombe’s Quartet” (Tufte 2001, 14), a set of four relationships that each show a Pearson correlation of +0.82, but which are wildly different (see Figure 1 below).

Similar problems with non-normal distributions may affect analysis of the relationship between funding source, generativity, and times cited. In any case, these relationships are incredibly small—among the reported eta-squared values, the largest is only 0.014. Whether or not the result is significant is not the issue; a relationship between variables that accounts for only 1.4% of the variance is too small to be of practical significance. The best conclusion to draw from these data is that there is no relationship between funding source (or its absence) and either generativity or times cited.

Ways to Look at the Data

Anderson and Feist have, of course, given us an exploratory study, so statistical and graphic nitpicking is not the main point. Instead, the real value of the study has to lie in the directions it points and the issues it raises. What they refer to as the “structure” of citations is an important aspect of scientific literature and, indeed, one that has been overlooked. Their operational implementation of generativity is potentially important, and it suggests a number of new ways to look at their data. In particular (and in the spirit of seeking to move toward a true recognition of transformative science), more attention needs to paid to the extreme outliers in their data. Thus, both generativity and times cited show two (or more?) points at extremely large values in Figures 6 (140) and 8 (141). Are these the same two papers (assuming there are only two), as suggested by the scatterplot in Figure 10 (142)? And what are they and where did they appear? What can be said about their content, the content of the citing articles, and about the purposes for which they were cited? If they are methodological contributions, instead of articles that report a new phenomenon, we might draw different lessons from their structural extremity.

Many other questions could be raised using the existing data set. Is there a relationship between generativity and the lag in citations? That is, are highly generative articles more likely to show citations increasing over time, as one would expect if the influence of a generative article is to generate more research (which takes time and sometimes funding), rather than simply nods to something interesting. Or, similarly, what does the “decay” curve of citations look like? One might find large differences, even among relatively low generativity articles in their “half life,” thinking perhaps that truly generative articles have a longer half-life than even highly cited, otherwise seemingly generative, articles. There is a great deal more to be learned here.

Since this is an exploratory study, it would also make sense to use exploratory data analysis (Tukey 1970) to search for structural patterns in the data set. For example, one could plot the relation between generativity and times cited by dividing the generativity data by deciles and looking at the distribution of times cited for each decile; if the middle ranges of generativity had approximately bell-shaped distributions of times cited, then Pearson correlation coefficients might be appropriate for quantifying the middle range of the relationship.

Finally, since the goal is to obtain information about the structure of citations (rather than simply their number), aggregate statistics like means, correlation coefficients, and the like seem to rather miss the point. For example, is it the case that highly generative articles have chains of subsequent citations that branch off when new articles citing them become themselves highly cited? If so, and if non-generative articles (which by definition have simple “fan-like” patterns without branching), one would have a direct look at the structure of the network of citations.

At the end of the article, Anderson and Feist make a number of suggestions for further research, all of which suggest gathering more data. These are welcome suggestions and should indeed be pursued, even, as they acknowledge, truly transformative science must ultimately await the judgment of history. In the meantime, I hope that this intriguing contribution can be further strengthened, expanded, and subjected to further exploratory analysis.


Barrett R. Anderson and Gregory J. Feist. “Transformative Science: A New Index and the Impact of Non-Funding, Private Funding, and Public Funding.” Social Epistemology 31, no. 2 (2017): 130-151.

Cleveland, William S. The Elements of Graphing Data. Monterey, CA: Wadsworth, 1985.

Tufte, Edward R. The Visual Display of Quantitative Information (2nd ed.). Cheshire, CT: Graphics Press, 2001.

Tukey, John W. Exploratory Data Analysis. New York: Addison-Wesley, 1970.

Figure 1: Anscombe’s Quartet

Author Information: Dorte Henriksen, Aarhus University,

Henriksen, Dorte. “Reply to Liberman and López Olmedo’s ‘Psychological Meaning of “Coauthorship” Among Scientists’.” Social Epistemology Review and Reply Collective 6, no. 7 (2017): 20-22.

The PDF of the article gives specific page numbers. Shortlink:

Please refer to:

Image credit: aKaMu aDaM, via flickr

The concepts of co-authorship and research collaborations seems both straightforward and at the same time very complicated. Several studies have emphasized that co-authorship practices differ depending on the research field, and this needs to be taking into consideration when examining research communication, collaboration and productivity. The study by Sofia Liberman and Roberto López Olmedo (2017) is a great contribution to the examination and discussion of these concepts. I will discuss their study based on my knowledge from the fields of scientometrics and sociology of science.

Measuring Co-Authorship

The first thing to note is that the authors state that there are different approaches in how scientific studies measures co-authorship, however, without referring to such studies. The co-authorship studies that have come to my attention measure co-authorship through the list of authors named in of byline of the same publication this creates a quantitative measurable link or bond between these researchers. Therefore, the measuring of co-authorship is straightforward.

The problem arises when research collaboration comes into measurement, since scientific studies use different ways of measuring research collaboration. Liberman and López Olmedo point out how “different types of collaborations entails different types of relationships between researchers (…).” Hence, it is problematic to equate co-authorship and research collaboration. Earlier bibliometric studies had a tendency to use co-authorship and research collaboration as synonymous concepts, and some studies still do. The common argument for using co-authorship as a proxy for research collaboration is that it is the best available indicator for quantitative studies of research collaboration, and co-authorship is a reflection of some kind of collaboration.

Hence, co-authorship is what links the researchers together by the publication in the formal or the “outer cycle” of science communication system. Researchers become authors through this link and establish themselves in both the science communication and reward system. The scientific norms in these systems assume that it is possible to identify and assign the individual intellectual responsibility of a piece of scientific work (Biagioli and Galison 2003). The tendency to co-author publications and the general rise in the average number of authors makes it more complicated to identify the individual contribution and necessary to discuss the concept of co-authorship. Not to mention, how this should incorporate into an examination and discussion of how different epistemic cultures affect researchers’ practices of co-authorship.

Liberman and López Olmedo’s study brings interesting aspects about how scientists conceptualize co-authorship, but it is not surprising that research collaboration and teamwork are among the most used words to define co-authorship for all fields, except for chemistry. If one examines co-authorship studies, it will probably be the same words appearing as definer words of such studies. However, the remaining definer words confirm many suggestions from previous studies (e.g. Corley and Sabharwal 2010, Lee and Bozeman 2005). Not to mention, that many of these words correspond to the Mertonian norms of science (Merton 1973), and focuses on how the collaboration and co-authoring improves the research. For example Sharing ideas and work, Richer ideas, and Ideas enrichment all focus on the synergy that collaboration adds to the research process. The words Learning and Knowledge fit the idea that collaborations occur because of needs for experts and educating junior researchers.

A Broader Scope

At the same time, one could question why the researchers use the word Active Participation, since in an ideal world one would expect all collaborators to be actively involved in the research process. Could this be an indication of problems with gift or career authorship? On the other hand, is it just a way of being inclusive, so all who contributed to the research project should be included as co-authors? It could be interesting to go deeper into the meaning of these words and discuss how they reflect certain research cultures. Similarly, the words More publications and productivity corresponds to the often-mentioned problems with publication pressure, where researchers need to spread their work in multiple projects to ensure no zero publishing periods.

The results of Liberman and López Olmedo study would benefit from a greater discussion and references to science communication and sociology of science studies, especially of the included research fields; physics, mathematics, biological sciences and chemistry. For example, multiple studies have concluded that the extent of research collaboration differs across subject fields, thus it affects the researchers’ perception and practices of co-authorship. Birnholtz (2006) interviewed researchers from CERN and found that in high-energy physics the practices of co-authorship do not correspond to the traditional model of authorship. The authorship it-self was a reward for working on a common project, and some admitted they have not even read the articles they were co-authoring.

Lariviere et al. (2016) examined the authorship contribution statements for PLOS ONE articles, and found differences in co-authors’ contributions depending on their field and rank. Physics has an egalitarian view on authorship, so they give all the authors credit for all kinds of contributions, while biomedicine and clinical medicine have a greater division of labor, and have a greater focus on the individuals reward. Chemistry is moderate, where execution and analysis of technical and experimental work, like life sciences, is highly associated with authorship, but often in association with another type of task (writing, designing experiment etc.). Mathematics is a vastly theoretical field with fewer authors on the research articles, which reflects the contribution statements giving equal credit and responsibility for all parts of the research article. The authorship and science cultures studies correspond very well with the results from the Liberman and López Olmedo study, and they enhance the validity of their study.

I was surprised about the results of the study by Liberman and Galán Díaz (2005) of the concept of international collaboration, where the findings show that researchers did not mention co-authorship as a main concept. Therefore, I checked their study and found that international publications were among the main concepts, and I might be over-interpreting, but the link from international collaboration to international publication is co-authorship. Thus, co-authorship is definitely among the mentioned concepts, and in association with the main concepts. Therefore, I think it could be interesting to repeat a similar study using the stimulus word collaboration to explore how researchers conceptualize research collaboration and whether they immediately think of co-authorship. This study would also reveal to what extent there are variability between the definer words for co-authorship, international collaboration and collaboration, as well as between different research fields. There would be a great possibility to do a comparative study based on the collected interview and survey data of these concepts and explore to what extent these concepts semantically overlap.


Biagioli, Mario, and Peter Galison. Scientific Authorship: Credit and Intellectual Property in Science. New York: Routledge, 2003.

Birnholtz, Jeremy P. “What Does it Mean to be an Author? The Intersection of Credit, Contribution, and Collaboration in Science.”  Journal of the American Society for Information Science and Technology 57, no. 13 (2006): 1758-1770.

Corley, Elizabeth A. and Megina Sabharwal. “Scholarly Collaboration and Productivity Patterns in Public Administration: Analysing Recent Trends.”  Public Administration 88, no. 3 (2010): 627-648.

Lariviere, Vincent, Nadine Desrochers, Benoît Macaluso, Philippe Mongeon, Adèle Paul-Hus, Cassidy R. Sugimoto. “Contributorship and Division of Labor in Knowledge Production.”  Social Studies of Science 46, no. 3 (2016): 417-435.

Lee, Sooho and Barry Bozeman. “The Impact of Research Collaboration on Scientific Productivity.”  Social Studies of Science 35, no. 5 (2005): 673-702.

Liberman, Sofia, and Carlos Robeto Galán Díaz. “Shared Semantic Meaning of the Concept of International Collaboration among Scientists.”  Journal of Information Management and Scientometrics 2, no. 2 (2005): 27-34.

Liberman, Sofia and Roberto López Olmedo. “Psychological Meaning of ‘Coauthorship’ Among Scientists Using the Natural Semantic Networks Technique.”  Social Epistemology 31, no. 2 (2017): 152-164.

Merton, Robert K. The Sociology of Science: Theoretical and Empirical Investigations. Chicago: The University of Chicago Press, 1973.

Author Information: Tommaso Castellani, Institute for Research on Population and Social Policies,; Emanuele Pontecorvo, Sapienza University of Rome; Adriana Valente, Institute for Research on Population and Social Policies, National Research Council of Italy,

Castellani, Tommaso, Emanuele Pontecorvo and Adriana Valente. “Epistemic Consequences of Bibliometric Evaluation: A Reply to Rip and Stöckelová.” Social Epistemology Review and Reply Collective 4, no. 4 (2015): 29-33.

The PDF of the article gives specific page numbers. Shortlink:

Please refer to:


Image credit: Jedediah Laub-Klein, via flickr

In writing a contribution on the consequences of bibliometric evaluation on the practices of doing science, we were aware of dealing with a very delicate matter, which may be easily subject to objections and misunderstandings.

We are grateful to Arie Rip and Tereza Stöckelová for having carefully read and commented our paper, helping us to identify in which directions our arguments can be reinforced and, not least, giving us the opportunity to further reflect on our work. Starting from their comments, we are going to further clarify and expand our reasoning. Namely, we are going to address three main issues:

1. The methodology of the work, in relation to its objectives;
2. The logical sequence of our reasoning;
3. The conclusions of the study.

We will develop these points in the following three sections.  Continue Reading…

Author Information: Tereza Stöckelová, Institute of Sociology, Czech Academy of Sciences,

Stöckelová, Tereza. “Unspoken Complicity: Further Comments on Castellani, Pontecorvo and Valente and Rip.” Social Epistemology Review and Reply Collective 4, no. 2 (2015): 17-20.

The PDF of the article gives specific page numbers. Shortlink:

Please refer to:


Image credit: Grufnik, via flickr

As academia changes, it is vitally important to reflect on and study these changes empirically. However, while bibliometrics, research assessment exercises and modes of publishing, more generally, constitutes a major aspect of these changes—and many of the unsettling insights offered by the paper under discussion resonate with my own research— the tendencies, as I will argue, are more differentiated, varied and ambiguous than what might be concluded from Castellani, Pontecorvo and Valente’s paper (2014). In my commentary, I will further develop selected points made by Rip (2014). These points will concern methodology, the active role of scientists in the proliferation of measurements in contemporary research systems and the situated nature of practices of valuing academic performance. I will draw upon my, and my colleagues’, research in the Czech Republic (Linková, Stöckelová 2012; Stöckelová 2012, 2014; Felt, Stöckelová 2009; Dvořáčková et al. 2014) where—similarly to Italy—bibliometrics and quantitative research evaluation have started recently to play a major role.  Continue Reading…

Author Information: Arie Rip, University of Twente,

Rip, Arie. “On Epistemic Effects: A Reply to Castellani, Pontecorvo and Valente.” Social Epistemology Review and Reply Collective 4, no.1 (2014): 47-51.

The PDF of the article gives specific page numbers. Shortlink:

Please refer to:


Image credit: Elliott Brown, via flickr

It is important to critically consider ongoing changes in scientific practices and institutions, and do that on the basis of relevant data of sufficient scope and depth. Thus Castellani, Pontecorvo and Valente’s piece on epistemological consequences of bibliometrics is to be welcomed. However, I will also be critical in my commentary, in the spirit of organized scepticism. Doing so forced me to think through some of these issues again. After such an Auseinandersetzung (as the Germans can phrase it), we all will at least be able to articulate the issues better.  Continue Reading…

Author Information: Tommaso Castellani, Institute for Research on Population and Social Policies, ; Emanuele Pontecorvo, Physics Department, Sapienza University of Rome; Adriana Valente, Institute for Research on Population and Social Policies, National Research Council of Italy,

Castellani, Tommaso, Emanuele Pontecorvo and Adriana Valente. “Epistemological Consequences of Bibliometrics: Insights from the Scientific Community.” Social Epistemology Review and Reply Collective 3, no. 11 (2014): 1-20.

This research has been supported by the ScienceOnTheNet project of the Italian Ministry for Education, University and Research.

The PDF of the article gives specific page numbers. Shortlink:

2890933648_8e232deaa9_z Image Credit: SamahR, via flickr


The aim of this paper is to investigate the consequences of the bibliometrics-based system of evaluation of scientific production on the contents and methods of sciences. The research has been conducted by means of in-depth interviews to a multi-disciplinary panel of Italian researchers. We discuss the implications of bibliometrics on the choice of the research topic, on the experimental practices, on the publication habits. We observe that the validation of the bibliometric practices relies on the acceptance and diffusion within the scientific community, and that these practices are self-sustained through their wide application. We discuss possible evolving scenarios, also considering the recent development of digital archives.

Continue Reading…