Proposed changes to IDEAS/RePEc ranking: Euclid and outliers

April 19, 2017

The IDEAS/RePEc rankings are a popular way to assess the strength of economists, serials and institutions. They are built on a large number of criteria that are relatively stable in definition. As rankings matter a lot for some, we do not want to disturb the definitions before prior approval by the community. Hence, we are putting to a vote several changes for the aggregate rankings of economists and serials. Voting ends one month from this post, 19 May 2017. Any approved change is expected to be available in the May rankings released in early June 2017.

Euclidian ranking for economists

The Euclidian ranking of economists has already been computed for several months. It is based on an AER article by Motty Perry and Philip Reny. The score is measured by taking the square root of the sum across all distinct works of the square of the number of adjusted citations, the adjustment being for the typical number of references in the field of the paper (the field is defined by NEP, if there are several fields a geometric average is used, no adjustment if field is not defined). Thus, this ranking favors those who have some work that that is much more cited than others. The other citation criteria that are currently used are sums of citations, several with citations weighted by various impact factors. The only ones that differ from this model are the H-index (which favors a more uniform distribution of citations across works), and criteria based on the number of economists citing.

The addition of the Euclidian criterion would thus introduce a new angle in the list of criteria: having some particularly influential work instead of a larger body of work. As noted in the article, this criterion also has a number of properties that no other criterion has. Vote below if you think such a criterion should be added to those retained for the aggregate ranking.

Exclusion of extreme criteria for economists

The procedure for the aggregation of the ranking criteria currently excludes the worst and best criteria for every economist. The rationale for this is that one should not be penalized too much for being particularly bad with one criterion, and not shoot up too much in the rankings if only one criterion is very good. The fact that only one of each is excluded has been repeatedly discussed in the community, and given that that we may be adding another criterion (potentially the 36th) is an opportunity to revisit this. The vote below asks whether more extremes should be excluded from consideration. Note that it will be assumed that if you vote for “3”, you would also approve of “2” as the current status quo is “1”.

Euclidian ranking for serials

Similarly to economists, an Euclidian ranking can be computed for serials (journals, working paper series, book series, chapter series). For serials, we similarly construct an aggregate ranking across criteria. This ranking is little used to our knowledge. The question here is whether to include the Euclidian ranking in that computation. Note that ranking is not yet available.

Euclidian ranking for institutions

It is currently not clear how the Euclidian ranking for institutions would be computed. The problem is how to treat economists with multiple affiliations. For other criteria that are based on simple sums, the current practice is to multiply the scores by the relevant affiliation share. This does not make much sense for a sum of squares. There is a similar problem for the H-index that was resolved by redefining it. Should a solution be found, the same aggregation approach would be used as for economists.

Exclusion of extreme criteria for institutions

This poll is the mirror image of the one for economists. The only difference is that we have currently 32 instead of 35 criteria. Due to this difference, a separate poll is offered.

Update, 19 May 2017 Polls are closed. The Euclidian ranking will be added and two best and two lowest criteria will be removed. Same rules apply for economist and institutional rankings. The latter will include experimentally the root of the weighted sum of square Euclidian scores of their members.

RePEc in March 2017

April 4, 2017

Over the past month, the new help page has been further expanded. We also got a large crop of newly participating archives: Central Bank of Malta, Bank of Russia, Waseda University, Inha University, Technische Universität Chemnitz, Vernon Press, Asian Online Journal Publishing Group, Université Paris 1 (II), European Systemic Risk Board, Luxembourg Income Study, University of Portsmouth, and Universidad Loyola Andalucía. We counted 620,664 file downloads and 2,348,514 abstract views. And we reached the following milestones:

80’000’000 abstract views on EconPapers
90 countries with RePEc archives

RePEc launches Top 5 Journal in Economics

April 1, 2017

Many academic departments in economics require from their junior faculty to publish in top 5 journals in order to gain tenure or get promotions. The top departments ask for several such articles, lower ranked ones may ask for only one. However, the space available in those journals is very limited, a couple hundred articles a year. Given that many already tenured faculty publish in those journals, the space for the newcomers is very scarce and few junior professors can count on top 5 journals for their tenure hopes.

This problem has become worse, as more and more departments strive for such impossible requirements, in part because they are forced to keep up with requirements in the other sciences of their university, where articles are much shorter and journals publish more frequently, thus making it easier to get top publications. Without intervention, economics may get into the situation of choking itself by making it impossible for most department to grant tenure to faculty. In light of this upcoming catastrophe, RePEc is happy to come to the rescue with the launch of a new journal that will be accepting submissions from junior faculty aspiring for tenure, the

Top 5 Journal in Economics

will start today with volume 104 and a special issue on the Economics of Fisheries. For submissions and more information about the journal, click here.