RePEc can help you with working off-campus

August 31, 2020

Now that in many universities classes are starting again, and in many cases this is happening through online courses, we thought it would be useful to show how RePEc can help. Of course, as RePEc is an open bibliography, this will be mostly about its bibliographic features.

As you provide readings or reading lists to your students, keep in mind that their access to the reading material may not be the same as when they were on campus. This matters particularly when they try to reach gated journal articles (and some of the few gated working paper series). Instead of giving your students links to the articles on the publishers’ websites, consider rather given them a link of the same article on EconPapers or IDEAS. Why? First, RePEc makes an effort to provide alternative, non-gated versions of the articles, typically as working papers, which can be accessed no matter where your students are. Second, RePEc provides more context to facilitate the exploration of the literature, such as links to references and citations, author profiles, etc.

RePEc makes it even possible for you to maintain online bibliographies that you can share. There are two options: If you want to share your reading list with everyone (and get a link to your reading list from the listed items), create it with this tool on IDEAS, which also lists the reading lists that have already been compiled. If you want to keep the reading list just for your students, you can create a bibliography folder with MyIDEAS, make it public and share a link with your students. Building your bibliography is easy: log in, navigate IDEAS, click on the “Save…” icon above the title of a paper or article, and once done assign the relevant items to a folder you can choose to make public.

Depending on your curriculum, you may want to add material related to Covid-19. At the time of this writing, there are over 4000 papers on the topic indexed in RePEc. To help you navigate this, use the RePEc Biblio, in particular the topic on economics of pandemics and more specifically on Covid-19.

Finally, with no workshops, seminars or conferences on location for the foreseeable future, much of this activity as moved online. To find what is scheduled, or to advertise your activities, check out the Economics Virtual Seminar Calendar.

And if you have suggestions on how we can further help, do not hesitate to contact us!

RePEc in July 2020

August 6, 2020

July is usually a very calm month, but we still got a good crop on new participating archives: Technical University Munich (II), Nazarbayev University, ECONtribute, Columbia University (II), Université Catholique de Louvain (II), National Academy of Sciences (USA), Asociación Argentina de Economía Política. Also, we counted 454,745 file downloads and 2,361,833 abstract views. Finally we reached the following milestones:

200,000,000 cumulative abstract views for articles
3,000,000 items available online
1,250,000 items with extracted references

A replication database for economics and social sciences: The ReplicationWiki

August 4, 2020

This is a guest post by Jan H. Höffler

The ReplicationWiki currently offers a database of 4,484 studies from the social sciences for which empirical methods were used. It lists which of the studies have data and code available online. In cases where replications are known they are classified by their type and results.

The topic of replication has become more and more prominent in the scholarly discourse in recent years. Yet, much needs to be done to make the availability of code and data more mainstream. To highlight how much work still lies ahead, even recent publications on the topic of replication in leading journals are not replicable and contain major flaws. For example, the authors of a study calling to make replication the norm that was published in Nature do not make their replication material available, ignoring the rules on data availability of the journal and the sponsor, the Berkeley Initiative for Transparency in the Social Sciences. Or, a study published in Research Policy came to the conclusion that work published in the top 5 economics general interest journals are less likely to attract replications published in leading journals, although the authors’ own data shows exactly the opposite.

So how can we get more replications to improve on the state of economics and discuss cases like the ones listed above? One important way is to include replication in the education of economists as was suggested by Daniel Hamermesh in his 2007 article on replication in the Canadian Journal of Economics. The ReplicationWiki followed this approach by setting up a teaching initiative that was presented, among others, at the Research Transparency Forum of the Berkeley Initiative for Transparency in the Social Sciences (BITSS) and Annual Meetings of the American Economic Association (2014, 2016). Seminars on replication were held at universities in Germany, Canada, China, and Switzerland and at a workshop in San Francisco with the Institute for New Economic Thinking Young Scholars Initiative, BITSS, and the Project Teaching Integrity in Empirical Research.

The advantage of the wiki approach lies especially in the fact that users can contribute to it without publishing a journal article. A working paper series was started for this purpose. Forum and blog posts can also be included as long as they have a verifiable author and make a contribution regarding the replicability of a published empirical study. On the studies’ discussion pages even very short comments can help other users like “To make the code work I had to add … at line …” or “The data has been moved to the following URL: …”.

For instructors, the wiki can help to identify examples for coursework as it allows searching for studies for which data and code are available, for which software was used that is accessible to the students, and for which a method was used that they should learn about. With the help of JEL codes and keywords preferred topics can also be searched for. Depending on the location of the students, it can also be motivating for them to see if research is available based on data from their home country (click here for an example). If it is not, they may be encouraged to compare results based on data from their country or region with the existing published research. For the students it can be an additional motivation if they can easily share their results with the research community via the ReplicationWiki.

The ReplicationWiki was described in more detail in a journal article. In the 2017 American Economic Review Papers and Proceedings an overview was given of economics journals’ data policies as well as of the distribution of the use of different software packages and of the geographical origin of the data used. In that article, some evidence was also presented that indicates that studies for which replication material is made available may attract more citations. This should be seen as a motivation for authors of empirical work who are willing to share their material to point this out by adding this information to the wiki. The ReplicationWiki has recently added a number of additional features. Now there are overviews of the methods, data sources and software used in the studies. In addition to replications the wiki now also provides information about corrections that have been published and whether studies have been retracted. Complex searches are now possible with a more user-friendly interface.

Initially the wiki covered studies mainly published in the Journal of Applied Econometrics, which already started an online data archive in 1995, the Journal of Political Economy, the American Economic Review and the four American Economic Journals. Now it covers studies published in 231 journals, 36 working paper series & blogs and 27 books. It lists 652 replications, 23 corrections and 14 retractions. As the wiki has been cited from a number of neighboring fields as an example to follow, it is becoming a hub for all social sciences. There have already been contributions in particular from political science and sociology.

The ReplicationWiki’s pages have been accessed more than 6.6 million times so far. It has been mentioned numerous times in the media, and more than 260 users from around the world have registered. As a wiki, it lives off the contributions of its users. We hope to encourage more users to contribute to this tool, or simply use it. In particular, one site feature that could become more valuable with higher participation is the ability to vote which studies should be replicated.

In July 2014, a cooperation with RePEc was started via a link exchange. For studies listed in the ReplicationWiki a link appears in the IDEAS section “Related works & more” under “Lists” like in this case, and on the authors’ pages under “Citations/Wikipedia mentions” like here.

Is your work listed? Check in and add it if not!