RePEc in April 2013

May 3, 2013

The statistic of the month is that over half a million items in RePEc are cited at least once, according to the CitEc citation analysis project. Speaking of citations, some changes to the way RePEc rankings are performed are currently up for vote, and a new ranking of economists by cohorts has been released. The latter exploits graduation data collected in the RePEc Genealogy. As for traffic, it was good, with 657,370 file downloads and 3,138,554 abstract views during last month.

An unusually large cohort of new archives joined us last month: World Intellectual Property Organization, IPEA (II), University of Windsor, Hyperion University, Warsaw School of Economics (II), INRA (VIII), Kharkiv National University of Economics, University of Sakarya, Institute for Social and Economic Change, University of Barcelona (III), ESADE Business School, KASBIT, Institut Ekonomskih Nauka, Centre of Excellence for Scientific and Research Journalism, Université d’Evry Val d’Essonne.

And the thresholds we passed were:

12000000 references extracted
3000000 downloads through NEP
500000 cited documents
40000 issued NEP reports
1000 books with extracted references
250 book series


Proposed changes to RePEc rankings up for vote

April 29, 2013

The RePEc rankings are a popular feature of RePEc. As we gather more information about the profession, we can also refine the criteria that are used for those rankings, as well as add more of them. With this post, we seek from our users their opinion about a few potential changes. For each proposed change a poll is attached, which we hope will help in deciding what to do.

Regarding citation counts

Citation counts are the basis for a series of criteria used in ranking authors and departments. Our citation project, CitEc, uses references from open access material, or those offered directly by publishers in their metadata, or from user contributions. But citations may also appear elsewhere and count be counted. One source is Wikipedia, which has a little less than 3000 references pointing to items in RePEc. Another is the RePEc Biblio, a curated bibliography of the most relevant research in an increasing number of topics (1100 references, but it is just starting). And a third one are blog post indexed on EconAcademics.org, the blog aggregator focusing on economic research (8000 blog mentions so far). The question here is whether references listed on Wikipedia, the RePEc Biblio or EconAcademics.org should count as citations for ranking purposes. All these citations are already listed on the relevant IDEAS pages, but they have so far not counted towards any statistic. As usual, self-citations would not count, as much as possible. For this poll, we want to distinguish whether they should count for the ranking of economists and institutions on the one hand, and journals and series impact factors on the other hand, or both.

Regarding breadth of citations

Citation clubs bias how we try to measure the impact of someone’s research. We have already some criteria that try to measure the breadth of one citations, the number of citing authors, and the same weighted by the citing author’s rank. Another way to measure breadth is to measure how widely an author has been cited across fields. For this, we can measure in how many NEP fields an author is cited. To this effect, the analysis is of course limited to working papers that have been disseminated through NEP, which has currently 92 fields. Again, self-citations are excluded, and this new criterion would only apply to author rankings.

Doctoral advisors and programs

The RePEc Genealogy is a crowd-sourced project that gathers informations about who studied under whom, where and when. From this information, one could determine who is the best dissertation advisor and which doctoral programs are the strongest. Some preliminary rankings are already available in this regard, based on the data that has been gathered so far: 1869 advisors and 499 programs at the time of this writing. It is expected that these numbers would significantly increase once a ranking would be incorporated. Instead of the h-index currently computed, it would be calculated in the same way that institutional rankings are determined: by adding up the scores of the relevant student for each criterion, and ranking within each criterion and then aggregating criterion ranks. As one can expect that only a fraction of authors and institutions can be ranked this way, all the others would be ranked right after the last author or institution with a student. It is to be expected that this ranking would matter mostly for the top ranked authors and institutions. Note that a ranking of economists by graduating cohorts is going to be first released in early May.

Exclusion of extremes

For author and institution rankings, the various criteria are aggregated after excluding the best and worst criterion. This was introduced when there were about 25 criteria. Now, there are 33 for authors and 31 for institutions. Depending on the outcomes of the votes above, there may be even more. Thus one may want to exclude even more extreme scores to avoid taking outliers into account. How many extremes should be excluded on each end? The status quo is one.

Questions or concerns?

Feel free to post a comment below!


RePEc in March 2013

April 4, 2013

What is new this month? Nothing much to report, for once, except that as MyIDEAS usage is expanding, we are now going to alert series and journal maintainers, editors and authors about how many people are following them. But as promised, we will not be revealing who it is. And, of course, we started fantasy leagues.

During the month, we counted 668,431 file downloads and 3,065,876 abstract views. Almost 500 authors registered, proving that there is still a large potential for growth in the RePEc Author Service. And we welcomed the following new archives: Institute of Accounting and Finance Kiev, Grantham Research Institute, Akroasis, Valahia University, Harvard University Press, Kobe University (II), Universidad de Guadalajara, University of Primorska, Ecological University of Bucharest, Duke University (II), Masaryk University, School of Oriental and African Studies, Gdansk University of Technology.

Finally, we reached the follow thresholds:
1000000 cumulative abstract views through Socionet
150000 cumulative downloads through Socionet
15000 listed books
6000 listed online books


Introducing the RePEc fantasy league

April 1, 2013

Fantasy (or rotisserie) leagues allow player to manage team members from a real-life competition to compose optimal teams. Fantasy leagues organize their own competitions and are popular in a variety of sports throughout the world. RePEc now has its own fantasy leagues, which allow players to manage economics departments. Specifically, there are two leagues.

Scratch league

Department owners in this league pick faculty members from the pool of authors registered in the RePEc Author Service and create departments from scratch. They need to keep a topical balance and all start with the same budget. Simulated departments are evaluated using the same criteria that underly the ranking of real life institutions.

Extant league

Here, department owners start from an existing department and then trade its faculty to improve it. Simulated departments are evaluated by comparing them to the existing ones they started from. Only economics departments are available for this league.

Markets

Both leagues work with separate markets for economists. Initial prices are based on current ranking scores of the registered economists. All currently registered economists are part of this market, and one can ask to be excluded from this market after log in.

Rules

Rules follow standard fantasy league rules. A few specificities for economists:

  • Departments in the scratch league require that economists work in a balanced set of fields. These are based on which topical NEP mailing lists disseminated their working papers.
  • One cannot short an economist.
  • Newly registered economists are added to the pool with an initial price corresponding to their ranking after the release of new monthly rankings (between the thrid and fifth day of the month.
  • Fantasy league rankings are not public.
  • A department owner cannot add him/herself to a department. If member of the original department in the extant league, he/she has to immediately trade him/herself.
  • One can play at most one department in each league.
  • Legues do not follow a seasonal schedule, they are continuously open.
  • Rules may be adjusted if the need arises.

Enjoy!


BEPress Journals Are Not Open Access Anymore

March 16, 2013

This is the usual story:  Once a free or reasonably priced journal is successful, it is bought, prices are raised, and access restricted. The lure of money is too tempting.

The most recent case concerns the BEPress journals that had pioneered open access in economics (well, actually quasi-open access, but this was acceptable). Aaron Edlin has sold them to DeGruyter, and quasi open access turned into gated access. The author’s rights are disregarded, of course.

We see here that well-defined property rights might bring about economic inefficiency: If a journal can be sold, it will be sold and turned into a goldmine, even if this is inefficient from an economic point of view. This can never happen to RePEc, as it is not owned by anybody. Under the presumption that open access is economically more efficient than gated access, ill defined property rights contribute to efficiency.

As an author make sure that you publish in a journal that cannot be sold, or is unlikely to be sold. Perhaps the existing free journal software should carry a clause that free use is permitted only for open access journals, and other uses are permitted only on paying a stiff fee. This would make credible to the authors that their work remains accessible and would solve the problem even with well-defined property rights, but this is unlikely to happen.


A compendium of RePEc services

March 12, 2013

Since its formal founding 16 years ago, RePEc has grown into a large collection of various services. Users are aware of some, but not all of them. This is an attempt to collect all services that use RePEc data. RePEc is in fact just a way of organizing and collection bibliographic data in economics. Publishers index their works and put it in the public domain through RePEc. Service then use this data in various ways, in part by enhancing it. All linked services are completely free to users and managed by volunteers.

Browsing and searching the database

These are the most basic functions you would want to do with a bibliographic database. Several services provide this. The most popular are IDEAS and EconPapers. Others include Economists Online and Socionet. What distinguishes these services is that they report usage statistics (see below). Yet others that use RePEc include: EconLit, EconStor, Google Scholar, Inomics, Microsoft Academic Search, OAISter/WORLDCAT, Scirus and Sciverse. Shop around and use the one that is the most to your liking!

Curated material

While most the services above provide the complete RePEc bibliographic data, it is the user who has to sift through the material to find what she needs. A few services act as facilitators by helping users with the help of editors who sort and curate the material. NEP disseminates through email and RSS feeds the latest working papers across over 90 fields. The new RePEc Biblio determines the 10-20 most relevant papers in a growing number of fields and sub-fields. EconAcademics.org identifies economic research currently being discussed in blogs.

Specifically for authors

Some services are especially geared towards authors. The RePEc Author Service allows them to create a portfolio of all the works listed in RePEc. Other services then can link from the works to the profiles, and authors can get statistics and new citation notifications. CollEc analyses co-authorship networks and allows, for example, to find how many steps removed from each other any two authors are. The RePEc Genealogy allows to see who graduated where and when and who was the advisor. Finally, the RePEc Plagiarism Committee handles potential plagiarism cases and votes on them, in particular whether to name and shame offending authors.

Statistics

Several RePEc services report traffic on their website, which allows to compute a host of statistics, which are displayed at LogEc. Those, along with citation numbers, allow to compute a large number of rankings of authors, institutions, and papers, including impact factors for serials.

And more

As already mentioned, there is a citation analysis project, CitEc, which uses complex algorithms to extracts references from pdf files and match them with RePEc content.

MyIDEAS allows a user to track other authors, JEL codes, journals or working papers series, as well as build a personal bibliography while browsing on IDEAS. The Socionet Personal Zone also provides some of these functionalities.

EDIRC is a directory of economics institutions with plenty of links to affiliated authors and alumni, as well as compilations of their publications.

Finally, for those authors who do not have the benefit of their local institution participating in RePEc with its publications (see instructions), the Munich Personal RePEc Archive (MPRA) allows them to upload their papers to be included in RePEc.


RePEc in February 2013

March 4, 2013

Last month, we have introduced yet another RePEc service, the RePEc Biblio. This is a curated bibliography of economics, wherein volunteer editors are incharge of a topic and identify the most important papers. Check it out, and volunteer as well! In other important news, we now have over half a million working papers listed, and we tracked now over 70 million file downloads through participating RePEc services (those that send us such statistics).

We also welcomed the following newly participating archives: Holistic Marketing Management, Fundatia Romana pentru Inteligenta Afacerii, Vilnius University, Universitatea Maritima din Constanta, Phoenix Yayinevi, Universitatea Dimitrie Cantemir, University of Bucharest, Istituto Regionale per la Programmazione Economica della Toscana.

In terms of thresholds we surpassed, we can mention:
70000000 downloads
500000 working papers listed
200000 cited working papers
35000 registered authors


The RePEc Biblio

February 25, 2013

We are proud to announce the launch of the latest RePEc initiative, the RePEc Biblio. This is a hand-selected collection of the most relevant articles and papers on a wide variety of economics topics. RePEc Biblio is organized as a tree, narrowing the topics as you follow its branches.

The RePEc Biblio lives from the contributions of volunteer editors. Consider helping out if you have taught a class on a topic and have already put together a literature list. Feel also free to contribute your vision of the best papers from your area of research. Volunteer editors are welcome to sign up to populate the tree, either by contacting the manager or the relevant topic editor who can open a sub-topic or sub-sub-topic. We are looking for editors in both the broadest and narrowest fields. And to encourage good editing, readers can rate the topic entries.

Note that IDEAS links from papers, articles, editor profiles, and JEL codes to the relevant RePEc Biblio topics. Authors also find mention of their papers in RePEc Biblio on their IDEAS citation pages.


The Purpose of Journals

February 14, 2013

The editor of the Economics Bulletin, John Conley, has noted that many things go wrong with economic journals. Here is the abstract of his letter:

This letter calls attention a recent trend in economics publishing that seems to have slipped under the radar: large increases in submissions rates across a wide range of economics journals and steeply declining acceptance rates as a consequence. It is argued that this is bad for scholarly communication, bad for economics as a science, and imposes significant and wasteful costs on editors, referees. authors. and especially young people trying to establish themselves in the profession. It is further argued that the new “Big Deal” business model used by commercial publishers is primarily responsible for this situation. Finally it is argued that this presents a compelling reason to take advantage of new technologies to take control of certifying and distributing research away from commercial publishers and return it to scholarly community.

According to Conley,

The purpose of academic journals is to facilitate scholarly communication, filter for errors, and maintain the record of scientific advance.

This is, in my opinion, an idealized conception that does not reflect  the purpose of economic journals anymore. For economic research, the current economic journals are largely redundant. Conley himself notes this:

I seldom actually read journals  any more. I research topics using Google Scholar, RePEc, SSRN, and so on. It is inconvenient to sign up  with publishers to get tables of contents emailed to me or to login to my university’s library web portal to  search a journal issue by issue. I find it adds very little value over a more general search in any event. In  short, certification remains important to help people gain tenure and promotion and to get a sense of the  quality and centrality of individual scholars. However, neither certification by a journal, nor the collection  of similar papers within the bound or even electronic pages of a specific journal has very much meaning to  me when I am trying to understand where the debate in a subfield is at any given moment. As a result, I  was beginning to come to the conclusion that while they are irritating, commercial publishers are “mostly  harmless” to the research enterprise itself as publishing itself is becoming mostly irrelevant.

This coincides with my own observation: researchers don’t need journals. The main purpose of the journals is currently to ease the work of hiring committees. People publish in order to get a job. The wish to communicate new findings appears secondary in most cases.

Journals could serve worthier aims, however: they are needed by students, college teachers, and others who would like to obtain reliable information but can not as easily  separate the wheat from the chaff as active researchers can.

The important point Conley is making is, however, that the current journal system, although largely irrelevant for research, is nevertheless

bad for scholarly communication, bad for economics as a science, and imposes significant and wasteful costs on editors, referees. authors. and especially young people trying to establish themselves in the profession.

I fear, however, that John Conley’s suggestion to increase the number of journals would not improve the situation very much. As long as hiring committees use the reputation of journals, rather than the reputation of individuals,  a useful system of  “communication, filter for errors, and maintain the record of scientific advance” is practically blocked.

What can be done besides increasing the number of journals? Here some further suggestions.

1. Hiring committees can restrict the number of papers to be considered for judging an applicant to, say, three and disregard all other writings. This may help to reduce the number of publications and thereby reduce the need for further journals; it would also tilt the quality-quantity trade-off in favor of quality. (I think this has been a practice in Berkeley.)

2. Hiring committees that feel incompetent to judge the substantive quality of a contribution and have to resort to statistics of some sort may turn to citation counts of individual authors, as obtainable through  Google Scholar, Web of Science, or RePEc). This is a better solution than the the current practice of relying on the prestige of journals and would take account of the fact that  many papers in top journals are not so good, and medium-quality journals publish excellent articles.


RePEc in January 2013

February 4, 2013

We have inaugurated this month MyIDEAS, the personal space on IDEAS that allows a user to follow other authors, series, journals and JEL codes. One can as well build a bibliography and organize it in folders. Find the login at the top of most IDEAS pages or directly here.

We have also welcomed the following institutions with new RePEc archives: Otaru University of Commerce, Romanian Distribution Committee, City University (II), UNDP (II), University of Cambridge (III), Universidad de Oviedo (II), University of Cambridge (II), Swedish University of Agricultural Sciences, Ukrainian Journal Ekonomist. Also with the over 1500 participating archives, this pushed us to over 1.2 million research items available on-line. Also, a record 610 people signed up on the RePEc Author Service. We counted 2,235,346 abstract views and 554,912 downloads from the reporting RePEc services over last month.

In terms of thresholds we surpassed, we can report the following:

1200000 items available on-line
800000 listed journal articles
750000 listed on-line journal articles