Benchmark Tasks • PatientLevelPrediction

Benchmark Tasks For Large-Scale Empirical Analyses

Here we provide a set of diverse prediction tasks that can be used when evaluating the impact of the model design choice when developing models using observational data.

Target Cohort (index)	Outcome	Time-at-risk	Link
Patients with an outpatient visit in 2017 with no prior cancer (first visit in 2017)	Lung cancer	1 day - 3 years after index
Patients newly diagnosed with major depressive disorder (date of first record)	Bipolar	1 day - 365 day after index
Patients with an outpatient visit in 2019	Dementia	1 day - 3 years after index
Patients with an outpatient visit and a positive COVID test	Hospitalization with pneumonia	1 day - 30 days after index
Patients with an outpatient visit and a positive COVID test	Hospitalization with pneumonia that required intensive services (ventilation, intubation, tracheotomy, or extracorporeal membrane oxygenation) or death	1 day - 30 days after index
Patients with an outpatient visit and a positive COVID test	Death	1 day - 30 days after index
Patients with T2DM who were treated with metformin and who became new adult users of one of sulfonylureas, thiazolidinediones, dipeptidyl peptidase-4 inhibitors, glucagon-like peptide-1 receptor agonists, or sodium-glucose co-transporter-2 inhibitors (date of secondary drug). Patients with HF or patients treated with insulin on or prior to the index date were excluded from the analysis. Patients were required to have been enrolled for at least 365 days before cohort entry.	Heart Failure	1 to 365 days
Patients newly diagnosed with atrial fibrilation (date of initial afib record)	Ischemic stroke	1 to 365 days
Patients undergoing elective major non-cardiac surgery (date of surgery). Patients were required to have been enrolled for at least 365 days before cohort entry.	Earliest of AMI cardiac arrest or death (MACE)	O to 30 days
Patients starting intravitreal Anti-VEGF (date of administration)	Kidney Failure	1 to 365 days
Pregnancy women (start of pregnancy)	Preeclampsia	During pregnancy
Pregnancy women (start of pregnancy)	Still birth	During pregnancy
Patients with COPD (first record)	Cardiovascular event and death	1-30 days and 1-90 days
Patients starting menopause (first record)	Depression	1 day - 3-years
Patients with anemia (date of first anemia record)	Colorectal cancer	1 day - 1-year
Patients with quadriplegia (date of first quadriplegia record)	Death	1 day - 1-year
Patient undergoing