MethodEvaluation is part of HADES.

Introduction

This R package contains resources for the evaluation of the performance of methods that aim to estimate the magnitude (relative risk) of the effect of a drug on an outcome. These resources include reference sets for evaluating methods on real data, as well as functions for inserting simulated effects in real data based on negative control drug-outcome pairs. Further included are functions for the computation of the minimum detectable relative risks and functions for computing performance statistics such as predictive accuracy, error and bias.

Features

  • Contains the OMOP and EU-ADR reference sets, and the OHDSI Method Benchmark and OHDSI Development Set for evaluating method performance using real data.
  • Function for inserting simulated effects in real data based on negative control drug-outcome pairs.
  • Function for computation of the minimum detectable relative risk (MDRR)
  • Functions for computing predictive accuracy, error, and bias

Technology

MethodEvaluation is a pure R package.

System Requirements

Requires R. Some of the packages used by MethodEvaluation require Java.

Installation

  1. See the instructions here for configuring your R environment, including Java.

  2. In R, use the following commands to download and install MethodEvaluation:

install.packages("remotes")
remotes::install_github("ohdsi/MethodEvaluation")

User Documentation

Documentation can be found on the package website.

PDF versions of the documentation are also available:

Support

Contributing

Read here how you can contribute to this package.

License

MethodEvaluation is licensed under Apache License 2.0

Development

MethodEvaluation is being developed in R Studio.

Development status

Ready for use.

Acknowledgements

  • This project is supported in part through the National Science Foundation grant IIS 1251151.