de Laat, Paul and Nicholas Munn. 2012. “Online Encyclopaedias: An Exchange” Social Epistemology Review and Reply Collective 1 (3): 10-13.
Please refer to:
- Munn, Nicholas John. 2012. “The New Political Blogosphere.” Social Epistemology 26 (1): 55-70.
- de Laat, Paul B. 2011. “Open Source Production of Encyclopedias: Editorial Policies at the Intersection of Organizational and Epistemological Trust.” Social Epistemology 26 (1): 71-103.
- de Laat, Paul and Munn, Nicholas. 2013. “Online Encyclopaedias: An Exchange.” Social Epistemology Review and Reply Collective.
Editor’s Note: Conducted over email during January and February 2012, this exchange between Paul de Laat, University of Groningen, and Nicholas Munn, Monash University, addresses issues in, and related to, their articles published in Social Epistemology 26.1 (2012). Both de Laat, in “Open Source Production of Encyclopedias”, and Munn, in “The New Political Blogosphere”, examine questions related to social epistemology and social media. This exchange focuses on online encyclopedias. Please go to “Social Epistemology and Social Media: An Exchange” to read Paul’s questions and observations and Nick’s replies to issues involving social epistemology and social media.
In this exchange, Nicholas Munn (NM) offers questions and observations to which Paul de Laat (PDL) responds.
NM: What is the relative importance of each of the online encyclopaedias examined? Has any one of them clearly been a leader/innovator, such that the others can be seen to adapt to them (i.e. Wikipedia)?
PDL: Wikipedia is the early innovator that adopted the wiki format (allowing everybody unrestricted and immediate access to textual entries). As mentioned in the article, (de Laat, 2012) many others adopted the same format later on. At the same time, they introduced ever more moderation and restrictions on access (in an effort to obtain the guarantees of expertise). Note that Wikipedia, in turn, has been inspired by the open source software movement that also allows access to the source code tree (at least if a contributor has been accepted as “developer”, not just “observer”). Note also, that h2g2 is the odd man out. It also started early on, but in their own ways (without a wiki).
NM: Might be interesting to expand the discussion out to cover other online encyclopaedias that have explicitly rejected the open source model, such as the Stanford Encyclopaedia of Philosophy (SEP). Is there an important difference in the epistemic status of a resource like this? Recalling the now famous argument that Wikipedia is just as good as Britannica (EB), does the same apply here?
PDL: Wikipedia might be of the same quality level as EB; at least if similar (scientific) topics are drawn into the comparison. (Why this might be so is a matter of speculation. I myself am working on the hypothesis that at least some amateurs have an opportunity in Wikipedia to learn and acquire so-called “interactional” expertise.) A whole new discipline is unfolding that compares the quality of outputs from the various encyclopedic models. As for the SEP, Wikipedian articles about philosophy may possibly match their quality. And then again I would speculate that this is so since 1) trained philosophers also provide a helping hand to Wikipedia, and 2) untrained philosophers obtain some training by participating in discussions on talk pages and working in the wiki; so gradually they are also able to contribute quality. But all this is pure speculation.
NM: We see from table 1 (de Laat, 2012, 77) that the other wiki based encyclopaedias all began much later than Wikipedia. To what extent do you believe that the differences in editorial style embraced by these other projects reflect an attempt to avoid ‘mistakes’ made by Wikipedia, or, if not mistakes, at least certain outcomes considered undesirable?
PDL: It is interesting to note that many encyclopedias in my sample distance themselves from Wikipedia explicitly (“we are not Wikipedia”). Citizendium advertises itself as Wikipedia “corrected” on 2 counts: 1) an account with one’s real name is required; and 2) experts are appointed as “topic editors” to oversee wiki developments in the entries that belong to their particular topic (and to prevent escalating “edit wars”). Scholarpedia and the Encyclopedia of Earth also employ a wiki — but in more restricted ways. Often only accepted experts may participate; moreover, participation can be on invitation only. So the whole idea of crowd participation is obviously undermined; the wiki turns into a content management tool.
NM: The wikipedian assumption of trust seems to work for many issues. That is, Wikipedia is often an excellent source for particular, non-controversial details. However, the assumption of trust also seems to breakdown in marginal cases, those where, for whatever reason, sharply opposed positions occur amongst the (potential) contributors. In such circumstances (evolution, abortion, various nationalisms), the wikipedian approach has obvious flaws …
PDL: Which flaws are you referring to? I only know that Wikipedia takes pains with such entries to keep them under control. All kinds of people are continuously watching the entries as they develop; both new edits and new entries are carefully patrolled. Banners often announce that this is a heated subject, that contributors should take care, that vandalist edits are likely to be deleted very quickly, that they risk to be banned, and so on and so forth. As a rule biographies of living persons in particular are closely watched. Take the entry on Obama. It is on ‘article probation’, meaning that disturbances and obnoxious behaviour are taken even more seriously than elsewhere, the standards of behaviour to be adhered to are much stricter than normal. If the lines are crossed just a little bit this will quickly result in banning users for the topic involved for a period of time. Or take cold fusion: it is placed under a regime of ‘disciplinary sanctions’, meaning (in a similar fashion) that the rules of proper Wikipedian behaviour are closely watched and transgressions strictly sanctioned. And take global warming: editing the entry is forbidden until tempers have calmed down (the page is ‘protected’; in this case ‘semi-protection’, meaning that experienced registered users may still edit).
NM: Given both the array of proposals for change in wikipedian practices and the apparent unwillingness of Wikipedia itself to embrace these changes, do you see a place for a new online encyclopaedia to pick up the basic strands of wikipedian ideas, and implement them in a way that avoids the issues Wikipedia has? Citizendium explicitly started with this idea, but seems to represent a rejection of the wikipedian approach rather than a modification thereof.
PDL: Citizendium cannot be interpreted as rejecting a Wikipedian approach: they endorse the wiki format, though with some extras (real names and topic editors). With this slightly modified approach they did not meet with a lot of success: the number of entries (about one percent of the Wikipedia total) and more in particular their growth rate are not spectacular, the enterprise seems to be stalling by now. Obviously, it is not easy to find a place under the sun when Wikipedia is around—an obstacle that any new encyclopedic venture will have to overcome. So in the end, I do not see any viable way of starting a new open-content encyclopedia in general. Wikipedia has simply grown too large. For niche topics some room may exist.
NM: Do reputation scores (de Laat 2012, 88-89) lead to unacceptably high barriers to entry for new participants in encyclopaedia projects? Is a new commentator to be treated initially as neutral, or do they have significant disadvantages to overcome simply in virtue of not having previously participated in the project? A possible solution is connecting edits to some ur-identity for each user, that runs over a range of areas. However, suggestions like this (for example, the increasing use of Facebook profiles for commenting on blog articles) have their own downsides, such as the apparent harms to women participants that result from abuse when the identity of the participant is known.
PDL: This has to be a misunderstanding. If the dynamic reputation model (de Laat 2012, 97-99) is introduced, newcomers by default obtain a low reputation score. This score then grows or diminishes in relation to the longevity of all edits contributed. Those who contribute many edits that stand the test of time see their reputation rise; those who contribute edits that soon perish (being deleted by co-contributors) will see their reputation sink. Nevertheless, there is no barrier to entry: anybody can start without any obstacles. But let us say the right to vote on proposals, to review new edits coming in, and so on, will only accrue to those with a high enough reputation. And vice versa, sinking reputation will imply closer scrutiny of one’s new edits than for average Wikipedians. The solution to seek guarantees in real-life identities (of a kind) has always been rejected by Wikipedia, since they feel that it may deter those contributors that prefer to remain anonymous but have much to contribute in spite of this. Not all ‘anons’ are vandals (an estimate is: only 20% of them)!
NM: Wikipedia suffers significantly from a lack of assurance, as set out on pages 92-94 (de Laat 2012). However, it seems as though a combination of ubiquity/size and multiple redundancy (in that for any topic included in the wiki, there are multiple willing contributors, who tend in time to balance their opinions/perspectives out), this flaw is in part addressed. As such, could one model the importance of the assurance standard as a function of the size and/or number of contributors to the wiki itself?
PDL: Possibly a model runs like this. Lack of assurances as associated with anons is mainly a problem in the short run: malevolent anons tend to enter the scene and leave. So whenever an entry is populated with at least some veterans that guard the gates, the vandal problem can be held in check. And that is pattern one sees often: a core of a handful of veteran Wikipedians (some 10% of all) are involved in an entry over a longer time and take the lead as to where the entry is heading. All along, they police unconstructive edits.
NM: The expertise condition seems vulnerable to the flaws mentioned regarding reputation scores above. Especially in light of the notoriously hostile environment of the internet to minority/disadvantaged contributors, the exclusion of legitimate sources of information through such entry requirements seems a real concern. If, as you suspect, an expertise-based approach is beginning to take hold in Wikipedia, I would be concerned that there will be a real loss of perspective entailed by this change.
PDL: Wikipedia is taking pains to combine the 2 perspectives. On the one hand, expertise (edit longevity, de Laat 2012, 96) may become important to calibrate the quality of entries (and stimulate further development). On the other hand, this is not to mean that anyone is to be excluded as source of information. Barriers to entry are and probably will remain very low (provided you have an Internet connection and speak an appropriate language). So what is the loss of perspective you are afraid of?
NM: The following passage “Finally, it has to be observed that in case the real contributory experts stay away from some Wikipedian areas, contributors with high edit longevity may only seemingly qualify as interactional experts in them.” (de Laat 2012, 97) brings to mind a comment I believe (but am not sure) David Chalmers made regarding Wikipedia, namely that he had given up on attempting to address certain flaws in its coverage of his areas of philosophical interest, because his alterations were being reversed on the grounds that Wikipedia did not consider him an authoritative source. (I could send him an email and check if I am recalling the particulars of this story correctly, if you would like?)
PDL: Authority obviously is a big problem in Wikipedia. Sanger (who founded Citizendium) is fond of saying that in the worst case, edit wars erupt causing entries to fluctuate around an equilibrium – but never reaching it entirely. I have no real answer to that — except for arguing that also in the sciences, editing conflicts often have no natural resolution and linger on. About climate change we still have wars going on, in spite of all the ‘real’ experts involved. So maybe Wikipedia is just reproducing a more general phenomenon.
De Laat, P. 2012. Open Source Production of Encyclopedias: Editorial Policies at the Intersection of Organizational and Epistemological Trust. Social Epistemology 26: 71-103.
Categories: Critical Replies