mmpf: Monte-Carlo Methods for Prediction Functions

Abstract:

Machine learning methods can often learn high-dimensional functions which generalize well but are not human interpretable. The mmpf package marginalizes prediction functions using Monte-Carlo methods, allowing users to investigate the behavior of these learned functions, as on a lower dimensional subset of input features: partial dependence and variations thereof. This makes machine learning methods more useful in situations where accurate prediction is not the only goal, such as in the social sciences where linear models are commonly used because of their interpretability. Many methods for estimating prediction functions produce estimated functions which are not directly human-interpretable because of their complexity: for example, they may include high dimensional interactions and/or complex nonlinearities. While a learning method’s capacity to automatically learn interactions and nonlinearities is attractive when the goal is prediction, there are many cases where users want good predictions and the ability to understand how predictions depend on the features. mmpf implements general methods for interpreting prediction functions using Monte-Carlo methods. These methods allow any function which generates predictions to be be interpreted. mmpf is currently used in other packages for machine learning like edarf and mlr (Jones and Linder, 2016; Bischl et al., 2016).

Cite PDF Tweet

Author

Affiliation

Zachary M. Jones

 

Published

June 28, 2018

Received

Apr 17, 2017

DOI

10.32614/RJ-2018-038

Volume

Pages

10/1

56 - 60

CRAN packages used

mmpf, edarf

CRAN Task Views implied by cited packages

Footnotes

    Reuse

    Text and figures are licensed under Creative Commons Attribution CC BY 4.0. The figures that have been reused from other sources don't fall under this license and can be recognized by a note in their caption: "Figure from ...".

    Citation

    For attribution, please cite this work as

    Jones, "The R Journal: mmpf: Monte-Carlo Methods for Prediction Functions", The R Journal, 2018

    BibTeX citation

    @article{RJ-2018-038,
      author = {Jones, Zachary M.},
      title = {The R Journal: mmpf: Monte-Carlo Methods for Prediction Functions},
      journal = {The R Journal},
      year = {2018},
      note = {https://doi.org/10.32614/RJ-2018-038},
      doi = {10.32614/RJ-2018-038},
      volume = {10},
      issue = {1},
      issn = {2073-4859},
      pages = {56-60}
    }