- Call For Papers
- Authors’ Guide to OpenReview
- Responsible NLP Research Checklist
- Author Checklist
- 2022 Submission Sites
- Volunteer to Be a Reviewer
- Volunteer to Be an Emergency Reviewer
Please refer to the list of venues and click through to the venue’s website to find out how to commit your paper + reviews.
Frequently Asked Questions for Authors
Submission and Review
Q: How does submission, review and resubmission to ARR work?
- When you have a paper ready, you submit to ARR. You then receive reviews.
- You consider your reviews.
- If you would like to make improvements to your paper, you do, and then you resubmit your paper to ARR, and provide a response to the previous round of reviews. You then receive reviews from the previous round reviewers and action editor, if available (note that you can request new reviewers under certain circumstances).
- If you would like to submit your paper+reviews to a publication venue (e.g. a conference), then you do that. The publication venue will make an accept/reject decision for your paper. If your paper is rejected, you may still submit your paper+reviews to other publication venues. See the questions below for more information.
Q: What types of submission are eligible for ARR?
A: ARR submissions should be original, unpublished work in the area of NLP broadly construed. Original just means no one else has done or published it yet. Theoretical, algorithmic, empirical, engineering and survey papers (among others) may represent original work. ARR welcomes short and long paper submissions. Three types of paper may be less suitable for ARR: a) papers that are not about NLP; b) submissions to shared tasks (because they are typically reviewed by the shared task organizers and participants; however, papers about the shared task, or papers using data from the shared task, are fine); and c) demo papers (because they are so hard to anonymize). Conferences and workshops will handle demo and shared task papers themselves. Please refer to the CFP for more details.
Q: What information do I have to provide to submit?
A: See the link to submit to the next deadline, below. Note that some of the fields are only required for resubmissions.
Q: I have reviews. How do I respond?
A: You respond to reviewers by making a resubmission. In the submission form, if you are making a resubmission, you should: a) provide the URL of your previous submission; b) upload the PDF of your previous submission; and c) upload a single PDF of your response to the previous round of reviews (for example, indicating how you modified the paper to answer reviewers’ questions).
Q: Why didn’t I receive my reviews on the 21s of the month as promised?
A: 21 is the earliest date to receive reviews. Unfortunately, we cannot guarantee this as it also depends on the availability of qualified reviewers who reviews the papers. ARR is unlike a regular conference setup and we don’t release all the reviews at the same time. Rather, we release it as soon as it is available. Having said that, we are working hard to make this process more smooth in the upcoming months and reduce any delay in the future.
Q: What should I do if my reviews are unfair or extremely low quality?
A: If you feel that you need a new reviewer or action editor for your paper, there are fields in the submission form (starting September 2021) where you can request one or more reviewers or the action editor to be replaced, and justify your request. These requests will be considered seriously and either accepted or denied based on their appropriateness.
Q: I want to submit my paper+reviews to a publication venue. How?
A: After you receive your reviews, you will indicate your interest in submitting to ACL 2022 through this link and to NAACL 2022 through this link.
Q: If I submit early, can I update my submission before the deadline?
Q: Does ARR import reviews from other publication venues?
A: No, ARR is a self-contained review system and all reviews are done within ARR. We do not import reviews that were done by other venues.
Q: Should all authors be registered on OpenReview when submitting to ARR?
A: In order for ARR to calculate conflicts of interest correctly, every author should have an OpenReview profile that is complete and up to date.
Q: I submitted to ICLR, but want to withdraw my paper to submit to ARR. This withdrawal will cause my paper to become deanonymized. Is that OK?
A: We follow the same policy as NAACL 2021. So:
- if your paper was posted to arXiv before the one month anonymity period required before submission to ARR, and withdrawn from ICLR within that time period, then you could submit it to ARR
- if your paper was not posted to arXiv but was deanonymized as a result of withdrawal from ICLR, you’d have to wait a month to submit to ARR
Q: How can I withdraw my submission?
A: You can withdraw your submission before reviewing starts by logging into OpenReview, clicking into your submission and then clicking the “trash can” icon in the top right. Note that per the CFP, any submission withdrawn more than 48 hours after the submission deadline cannot be resubmitted before the second subsequent ARR cycle.
Q: I have further questions about ARR submission, where do I contact?
A: Please contact:
Q: When am I allowed to post a non-anonymous preprint?
A: Please see the Call for Papers for a detailed policy. If you post a non-anonymous preprint, you will be asked to provide the URLs in the submission form. You can always host an anonymous preprint in the ARR system itself, there’s a simple checkbox in the submission form.
Q: Can a paper be submitted to a non-archival venue during the anonymity period given that the paper, if accepted will be presented at the workshop during the anonymity period?
A: The ACL and ARR anonymity policies do not forbid you from talking in small venues about your work, but be careful not to publish a non-anonymized draft of the work and please do not publicize it widely (e.g. on social media).
Q: Which are acceptable anonymized links for submission of Supplementary materials?
A: You can create a throwaway github account and put the anonymized code there, or use other anonymization services as well, e.g., : 1) Anonymous GitHub and 2) ANONYM SHARE.
Reviews for Data
Q: The submission form has a question asking if I agree for the anonymized metadata associated with my submission to be included in a publicly available dataset. What is this?
A: The ACL Exec has approved the creation of an opt-in corpus of submissions and reviews. This corpus is being assembled by a group separate from the ARR editorial team. The review meta-data associated with your submission, i.e. scores, anonymous reviewer identifiers etc., will only be included if both you and the reviewers agree. Submission and review texts are not included in this consent and are handled separately.