Getting Started

MRMCaov is an R package for statistical comparison of diagnostic tests - such as those based on medical imaging - for which ratings have been obtained from multiple readers and on multiple cases. Features of the package include the following.

  • Statistical comparisons of diagnostic tests with respect to reader performance metrics
  • Comparisons based on the ANOVA model of Obuchowski-Rockette and the unified framework of Hillis
  • Reader performance metrics for area under receiver operating characteristic curves (ROC AUCs), partial AUCs, expected utility of ROC curves, likelihood ratio of positive or negative tests, sensitivity, specificity, and user-defined metrics
  • Parametric and nonparametric estimation and plotting of ROC curves
  • Support for factorial, nested, and partially paired study designs
  • Inference for random or fixed readers and cases
  • Conversion of Obuchowski-Rockette to Roe, Metz & Hillis model parameters and vice versa
  • DeLong, jackknife, and unbiased covariance estimation
  • Compatibility with Microsoft Windows, MacOS, and Linux

Documentation: User Guide

Installation

Enter the following at the R console to install the package.

install.packages("MRMCaov")

Citing the Software

## Text format
citation("MRMCaov")

To cite MRMCaov in publications, please use the following two
references, including the R package URL.

  Smith BJ, Hillis SL, Pesce LL (2023). _MCMCaov: Multi-Reader
  Multi-Case Analysis of Variance_. R package version 0.3.0,
  <https://cran.r-project.org/package=MRMCaov>.

  Smith BJ, Hillis SL (2020). "Multi-reader multi-case analysis of
  variance software for diagnostic performance comparison of imaging
  modalities." In Samuelson F, Taylor-Phillips S (eds.), _Proceedings
  of SPIE 11316, Medical Imaging 2020: Image Perception, Observer
  Performance, and Technology Assessment_, 113160K.
  doi:10.1117/12.2549075 <https://doi.org/10.1117/12.2549075>,
  <https://pubmed.ncbi.nlm.nih.gov/32351258>.

To see these entries in BibTeX format, use 'print(<citation>,
bibtex=TRUE)', 'toBibtex(.)', or set
'options(citation.bibtex.max=999)'.
## Bibtex format
toBibtex(citation("MRMCaov"))
@Manual{MRMCaov-package,
  author = {Brian J Smith and Stephen L Hillis and Lorenzo L Pesce},
  title = {{MCMCaov}: Multi-Reader Multi-Case Analysis of Variance},
  year = {2023},
  note = {R package version 0.3.0},
  url = {https://cran.r-project.org/package=MRMCaov},
}

@InProceedings{MRMCaov-SPIE2020,
  author = {Brian J. Smith and Stephen L. Hillis},
  title = {Multi-reader multi-case analysis of variance software for diagnostic performance comparison of imaging modalities},
  booktitle = {Proceedings of SPIE 11316, Medical Imaging 2020: Image Perception, Observer Performance, and Technology Assessment},
  editor = {Frank Samuelson and Sian Taylor-Phillips},
  month = {16 March},
  year = {2020},
  pages = {113160K},
  doi = {10.1117/12.2549075},
  url = {https://pubmed.ncbi.nlm.nih.gov/32351258},
}