This document is a DRAFT guidance.
If you accept an invitation to perform a peer review on a cohort definition submitted to the OHDSI Phenotype Library, please review this guidance document.
The workgroup lead or designee moderator will interpret your review and assign a level of confidence to the submission. The levels are incremental, meaning a definition that has level 3 status should have also met levels 2, 1, and 0.
All cohorts in this level have passed the minimum submission requirements detailed here. They are now ready for peer review. If rejected, the cohorts will remain in Level 0, with a withdrawn = TRUE status.
These cohorts have completed at least one peer review, accepted based on a high-level summary of the evaluation contributed by the submitter. This level is the lowest level of review; we expect > 90% of definitions that have passed Level 0 to pass Level 1 review.
These cohorts have completed at least one peer review, accepted by the reviewer. Acceptance requires: - Independent review of Cohort Diagnostics (and PheValuator when available) from the submitter. - Verification that errors such as sensitivity errors, specificity errors, and date misclassification errors are discussed and observed. - Independent evaluation for errors by reviewing submitted materials. - A recommendation to accept the definition with known errors.
A peer reviewer has reviewed the definition and independently performed an evaluation on a new data source, accepting the definition with known errors. The second reviewer should use a data source not part of the original submission for the review. See evaluation guidance.
The cohort definition has been used in multiple studies, publications, or workshops, and there is a general consensus that it is well-adopted. Its performance characteristics have been stable in different types of data sources. The definition has been referenced and used by others, and the output is considered high quality.