The aim of the JOAD peer review process is to ensure that each paper correctly describes the data, and that it has been openly archived in accordance with best practices. The datasets themselves are not reviewed in terms of validity or importance. Negative results for example can be useful to other researchers, and even data with inaccuracies (known or unknown) can help others to better contextualise research conclusions.
All JOAD data papers are peer reviewed according to the following criteria:
|1. The paper contents
- The methods section of the paper must provide sufficient detail that a reader can understand how the dataset was created, and would within reason be able to recreate it.
- The dataset must be correctly described.
- The reuse section must provide concrete and useful suggestions for reuse of the data.
||2. The deposited data
- The repository the data is deposited in must be suitable for this subject and have a sustainability model (see our list of recommended repositories).
- The data must be deposited under an open license that permits unrestricted access (e.g. CC0, CC-BY).
- The deposited data must include a version that is in an open, non-proprietary format.
- The deposited data must have been labelled in such a way that a 3rd party can make sense of it (e.g. sensible column headers, descriptions in a readme text file).
- The deposited data must be actionable – i.e. if a specific script or software is needed to interpret it, this should also be archived and accessible.