API Open Research Corpus Supp.ai Dataset Contact

Download Instructions

The papers are provided as JSON objects, one per line. Archives are partitioned in batches and shared as a collection of gzipped files.

A license agreement is provided. By downloading this data you acknowledge that you have read and agreed to all the terms in this license.

To download the partitioned archives, you have two choices:

The preferred method for download is to use the AWS CLI to download direclty from S3:

aws s3 cp --no-sign-request --recursive s3://ai2-s2-research-public/open-corpus/2020-02-01/ destinationPath

Alternatively, you can download the manifest via http, and use it to download all archive files via http as well. For example, using wget:

wget https://s3-us-west-2.amazonaws.com/ai2-s2-research-public/open-corpus/2020-02-01/manifest.txt
wget -B https://s3-us-west-2.amazonaws.com/ai2-s2-research-public/open-corpus/2020-02-01/ -i manifest.txt

Most Recent Release

2020-02-01 Sample S3 URL Manifest

Previous Releases

2020-01-13 Sample S3 URL Manifest
2020-01-01 Sample S3 URL Manifest
2019-11-01 Sample S3 URL Manifest
2019-10-01 Sample S3 URL Manifest
2019-09-17 Sample S3 URL Manifest
2019-01-31 Sample S3 URL Manifest
2018-05-03 Sample S3 URL Manifest
Pre-2018 archives are available as a single file:
2017-10-30 Sample Full Download
2017-02-21 Sample Full Download