Toward a New Compendium of Knowledge (longer version)
September 15, 2006 (and getting slowly out of date!)
Here's a shorter version, which might be more readable.
According to one source, there are over one billion (a thousand million) people on the Internet. That means there must be tens of millions of intellectuals online--I mean educated, thinking people who read about science or ideas regularly. Tens of millions of intellectuals can work together, if they so choose. Technologically, there is nothing standing in their way. This is truly a dumbfounding, incredible situation. Humanity has not even begun to explore the possibilities inherent in this situation. For all the endless talk about "Web 2.0," we have hardly even begun to think about harnessing this intellectual power for knowledge-building projects, much less actually act on it.
Imagine what is possible with tens of millions of intellectuals working together on educational and reference projects. (The trouble, of course, is actually getting them together--"herding cats" is the operative phrase.) What could attract them to pool their intellectual power? What content creation systems would best harness this power? What fantastic things might result? Imagine the discussions, the journalism, the news summaries, the textbooks and educational material, the encyclopedias, the libraries, the multimedia, the 3D universes, not to mention brand new sorts of resources possible for the first time and only through massive collaboration. The paltry first steps we have made on such resources are admirable, but ultimately will prove to be laughable compared to what will exist in five or ten years. It will resemble the difference between the first PCs and the firepower of the latest business-class desktops.
Whenever I think about this now, I literally quiver with excitement, and I am amazed that we, educated people throughout the world, have barely begun to imagine what new reference and educational materials could come into being, if we pool our efforts in the open, collaborative ways demonstrated by open source software hackers. Even less have we begun to take such possibilities really seriously, or actually get to work on them.
But this is changing very rapidly, and I want to make a prediction. In the next year, by the end of 2007, every major university, library, museum, archive, professional organization, government, and corporation will be asking themselves with increasing urgency: how, using what systems and methods, can we pool the entire world's intellectual resources to create the ideal information resource? What worldwide projects and organizations should we join or help to create?
We may take Wikipedia as an early prototype of the application of open source hacker principles to content rather than code. I want to argue that it is just that, an early prototype, rather than a mature model of how such principles should be applied to reference, scholarly, and educational content.
Wikipedia, started only five years ago, now has millions of articles in over one hundred languages, and has nearly singlehandedly introduced the world's intellectuals to the possibilities of enormous collaborative efforts. It is a project that shouldn't work, but does--who could have expected such a radically open project to produce anything of value? But, by giving intellectuals the world over an open platform on which to work together, a clear task, and a simple interface, Wikipedia has shown a global audience what enormous, distributed knowledge collaboration can achieve. The work of the Wikipedians has astounded the world.
I always have been an enormous fan of Wikipedia, and I still am. But I have achieved notoriety with some of Wikipedia's community and supporters by declaring that we can and should do better. I now want to help launch something better, if that's possible. Let me explain why I am doing so, and then I will describe the project itself.
When on January 2, 2001 I first had the idea for Wikipedia, and then got to work defining policies and leading the community that built it, I was also employed as editor-in-chief of Nupedia, a more straight-laced, peer-reviewed free encyclopedia project. Wikipedia was to be a free-wheeling, fun side project, a dynamic source of content, for the more serious Nupedia project. Wikipedia was closer in spirit to the old open source, hacker ways, where Nupedia was essentially an academic project. But together, Nupedia and Wikipedia were going to be an "unstoppable high-quality article-creation juggernaut," or so I said in 2001.
I will not go into the history very much, which I've done elsewhere, but I want to recount a few relevant details. Contrary to popular belief, Nupedia did not fail simply because its system was too complicated and closed. Rather, in 2001 and the beginning of 2002, I was working so hard on Wikipedia that I was greatly overextended--and so, Nupedia effectively lost its editor-in-chief. Few people know, or remember that: Nupedia withered in large part precisely because I was focusing on Wikipedia instead. But by the end of 2001, the Nupedia Advisory Board had agreed to relaunch the project with a greatly simplified two-step system. That's another thing a lot of people don't know about Nupedia. However, by that time, the Internet economy had collapsed and so Bomis, the company of which Jimmy Wales was CEO, and which hired me to start these encyclopedia projects, lost the ability to pay me. I had to resign. This hit Nupedia much harder than Wikipedia, since Nupedia was much more of a top-down project.
After that I twice offered Jimmy Wales a way to keep Nupedia alive. Once, I offered to find an academic sponsor--a university or foundation--for Nupedia. Another time, I offered to find the money to buy the domain name and subscriber list myself. Jimmy essentially turned down both offers. I could have saved it, and I wanted to save it, but Jimmy did not support the idea. It seems that with Wikipedia, he had found the only model that he wanted to survive. But the result was that only half of the original conception of "the finest encyclopedia in the history of humankind"--the wild-and-woolly half--was preserved.
Not surprisingly, with only one-half of the original design, some problems with Wikipedia--problems that continue to this day--emerged. Wikipedia quickly showed itself to have a wonderful system for producing massive amounts of reasonably good content quickly. But that does not mean that, as an encyclopedia and as a community, it is free of serious and endemic problems:
Can Wikipedia recover from these problems? The first step to recovery is admitting that you have a problem in the first place. Wikipedia's most passionate defenders, if they react at all, will probably do nothing but explain why I am mistaken in each of these criticisms. There are some active Wikipedians who are able admit at least some of these criticisms. But could the Wikipedia community as a whole admit any of them, with enough force actually to do anything about them? I am now, I fully admit, an outsider looking in on the project. But I do still watch the project a fair bit, follow the news about it, and read mailing list posts and events on the wiki. So I know of course that there are movements afoot to reform Wikipedia in various ways. But I see little evidence that the community, whatever its discontents, will go so far as to admit the problems I've listed.
The failure to recognize these serious problems is a reflection of the fact that, at bottom, they are political problems. Like all open communities online, Wikipedia's community is self-selecting, and its policies have determined who stays and who leaves (or is driven away). For this reason, online communities tend to become rather conservative in their attitudes toward their own systems, and Wikipedia is certainly no different. So it is not surprising that, as anyone who is aware of how Wikipedia works knows, the changes made to the system recently have been mostly cosmetic, and even the bolder of these changes have little chance of solving the problems I outlined earlier. The first step to solving a problem is to admit that it's a problem; and much of the Wikipedia community will not admit the problems I've listed, unless they have a massive collective change of heart. And, I think, that is very unlikely ever to happen. In fact, you could say that I have waited for several years for it to happen, and it never has.
[Note, January 2007: while we are still full steam ahead with a fork of Wikipedia's processes, we are having second thoughts about forking Wikipedia's articles. We've decided as an experiment actually to delete all the unedited Wikipedia articles from our database, to encourage people to start new articles altogether. We think this might encourage even more activity than we've had--though we're pleased with the amount of activity we've had so far--and help us to create a more distinctive Citizendium culture.]
Often (not always), if you wish to make any very important changes to an open source or open content project that has an entrenched community, the only way to do it is to start a new community. And that is what I propose.
I propose a fork of Wikipedia to be called the Citizendium, that is, the Citizens' Compendium. I doubt I have to remind many people in the audience of this, but the open content license, the GNU Free Documentation License, permits other communities to work on their own versions of the content from the parent project. So, legally, this project is clearly permitted. I think it is also morally permitted--perhaps even morally recommended--if there is a chance of retaining Wikipedia's virtues while eliminating the problems I just mentioned.
I propose to start what we might call a "progressive fork." A progressive fork works like this: we will begin with all of Wikipedia's articles, so that the Citizendium will begin as, simply, a mirror of Wikipedia. Then people start making changes to articles in the Citizendium. On a very regular basis, we will refresh our database with the latest versions of Wikipedia articles. If the Citizendium has not changed an article, while Wikipedia has, then we proceed to upload the most recent Wikipedia article. But if the Citizendium has changed an article, then it is not refreshed. That's when that particular article is forked. Of course, I have no doubt that tools will be written immediately that will allow users to compare the differences between the Wikipedia article and the corresponding Citizendium article side-by-side. In addition, of course, people will be able to start brand new articles on topics Wikipedia has not yet covered.
Obviously, you want to know how the Citizendium editorial system will differ from Wikipedia's system. There will be three main areas of dissimilarity. First, the project will invite experts to serve as editors, who will be able to make content decisions in their areas of specialization, but otherwise working shoulder-to-shoulder with ordinary authors. Second, the project will require that contributors be logged in under their own real names, and work according to a community charter. Third, the project will halt and actually reverse some of the "feature creep" that has developed in Wikipedia. Allow me to elaborate these differences.
Before I elaborate, however, let me assure you that I do not think that I necessarily have all of these details right. Obviously, I am fallible and, like all of us, my understanding is limited. Clearly, this project needs as much intelligent input as it can get. So I want to start a debate among people who agree with me about Wikipedia's problems and with at least many of the suggestions here. Together we can settle upon, and get broad community buy-in for, the best set of policies.
Third, over the years, Wikipedia has suffered some feature creep. The Citizendium will be deliberately simplified and kept simple:
Fourth, copyright and libel abuses will be handled quite differently. There will be a zero tolerance policy toward such abuses. Moreover, the living subjects of Citizendium articles will receive much more courteous treatment than they have sometimes received from the Wikipedia community. Among other things, this might mean that they would be able to request removal of biographies about themselves--if they are not politicians or other prominent public persons--or even to have a crucial editorial role in the articles about themselves. Essentially, I want to make the Citizendium a project with which John Seigenthaler, Sr. and Bernard Haisch are comfortable.
Finally, the Citizendium won't officially call itself an encyclopedia. We might call it an experimental workspace, to start articles and to improve article quality. It will require a vote of the project's future governing body or bodies for us to call ourselves an "encyclopedia" officially. Until then, we will be a "compendium."
So much for the differences, and as I hope you can see, they are significant. But it is important to note that the system will still work very much the way Wikipedia does, in many respects.
Areas of similarity include:
[Note, Jan. 2007: this section is now old news entirely and may be safely skipped.]
Finally, I want to discuss the way forward--in other words, how to get the project started. First, let's talk about the short term, the medium term, and the long term.
I stipulate that, whatever else we do, we should have the servers and the wiki software set up, and available at least to some beta testers, as soon as possible.
While waiting for the wiki to be set up, what can the ordinary rank-and-file future authors or editors do? Three things: first, join the project forums or a project mailing list (the list called Citizendium-L at least); second, contribute your thoughts to the discussion; and, third, wait for the announcement that the wiki is ready to edit. I want to start the project with a bang. I would like to strain the limits of whatever server configuration we put in place. Also, a donation at this crucial juncture would help get this venture off the ground.
So much for the short term. As to the medium term, over the coming weeks, I hope the Citizendium project will be contacted by individuals as well as universities, foundations, and companies. My personal belief, which I do not hold very strongly, is that the latent interest in and support for this project will allow us to collect a truly stellar group of advisors and partner institutions; if so, this experiment might succeed brilliantly. As to what we need, precisely, please see the project FAQ for some ideas.
Once the wiki has launched, we should begin to form discipline-specific editorial groups. They will have their own forums or mailing lists and eventually their own meetings. I want to emphasize at the outset to potential editors that their role in the wiki is not to control the wiki with an iron fist, not to throw up roadblocks to work, but instead to facilitate work by making binding decisions as needed. There will be rules to this effect. Editors and editorial workgroups alike must be committed to working within the wiki format--they must not try to change it into something that it is not.
Also once the wiki has launched, I think we should immediately hold a series of monthly face-to-face meetings in about a half-dozen major cities in the United States, Canada, Great Britain, and Australia (or New Zealand)--English-speaking countries, because the plan is to organize the English language project. I hope the first meeting will be in the San Francisco Bay area (close to where I live) in October, but nothing has been set.
I think perhaps the best way to get these meetings started is if academic departments send the Citizendium project leadership an invitation to host a workshop about the Citizendium. Based on the invitations we receive, we will establish a workgroup to decide when and where these meetings will take place. At the meetings themselves, then, we will get to know each other and talk about the project. At the same time, I, and other project leaders who join the project, will hammer out constructive, operational partnerships, do interviews, and so forth. We will also use the meetings as platforms to promote the project itself to the larger community of intellectuals.
But note that since the project is necessarily widely distributed, and almost no one will be able to attend all meetings, important decisions will not be made at these meetings. Except for the last meeting. I conceive of the last of these meetings--perhaps in March, 2007--as a constitutional convention, in which the essential policies of the project and its governance are hammered out and adopted by the advisory committee.
My notion--and at this point, I could be persuaded to do things differently--is to focus first on organizing the English language project formally. The other Citizendium wikis, in other languages, could be launched at the same time as the English Citizendium wiki. But my current thinking is that if the management of the non-English Citizendia require my personal assistance, that assistance would probably be best rendered after going through a pilot process in the English language.
But I hope you will interpret (correctly) the fact that I am making this announcement in Germany as indicating my personal commitment to making this project fully international as quickly as is feasible and responsible to do. On the other hand, I do not want to presume to speak for the interested German-speaking community online. Knowing as you now do that I personally am getting behind a fork of the English language Wikipedia, I put the question to you: should we also make similar forks of the Wikipedias in other languages?
Anyway, I think that, whatever Citizendia actually are created, each different Citizendium should probably adopt its own charter and have a separate management. Once the Citizendia in a dozen or so major languages have reached that stage of development, we can have fully international meetings, with delegates from each organization.
By the way, I am not averse to considering the argument that we ought to have these organizational meetings all around the world. I just want to make sure that the resulting projects have some important, baseline principles in common, and are interoperable. The whole question of how to achieve internationalization is one I hope we will discuss on one of the project's mailing lists, Citizendium-World.
While this organizational work is going on, I wish to put together the finest possible set of advisors for this project. Their role as advisors will give them a special platform from which to advise the project and speak on its behalf. Moreover, it is this group of people who will meet at the constitutional convention to ratify the project's charter.
So, let us create a vibrant yet responsible new community. Together we will, I think, have an amazing journey. To the extent that I can influence this new community--which will, I am sure, nearly instantly take on a life of its own--I want to encourage a set of values. These values may be grouped into sets, as follows: