Starting with the ARR May cycle and continuing in subsequent cycles, ARR has updated the author and reviewer license agreements.
The main updates clarify the types of peer review data that may be donated and collected. Under the updated protocol, collected data may include paper drafts, review text, review scores, metadata, before-and-after-rebuttal versions of reviews and scores, and author-flagged review issues.
The updated agreements also clarify the grace period for public release of donated data. Donated data for accepted papers may be made publicly available after acceptance. For papers that are not accepted, donated data will remain confidential for two years following the submission date and may be released publicly thereafter.
Authors, reviewers, and meta-reviewers can find the full updated protocol here: https://arr-data.aclweb.org/protocol/
ARR Data Collection is a community-driven effort to collect and curate a large-scale dataset of peer reviews and associated metadata from the ACL community, with the goal of supporting research on peer review and improving reviewing practices in our conferences.