xgrid and R: Parallel Distributed Processing Using Heterogeneous Groups of Apple Computers

Abstract:

The Apple Xgrid system provides access to groups (or grids) of computers that can be used to facilitate parallel processing. We describe the xgrid package which facilitates access to this system to undertake independent simulations or other long-running jobs that can be divided into replicate runs within R. Detailed examples are provided to demonstrate the interface, along with results from a simulation study of the performance gains using a variety of grids. Use of the grid for “embarassingly parallel” independent jobs has the potential for major speedups in time to completion. Appendices provide guidance on setting up the workflow, utilizing add-on packages, and constructing grids using existing machines.

Cite PDF Tweet

Published

May 31, 2012

DOI

10.32614/RJ-2012-006

Volume

Pages

4/1

45 - 55

CRAN packages used

GridR, Rmpi, snow, multicore, xgrid, runjags, poLCA

CRAN Task Views implied by cited packages

HighPerformanceComputing, Bayesian, Cluster, Multivariate, Psychometrics

Footnotes

    Reuse

    Text and figures are licensed under Creative Commons Attribution CC BY 4.0. The figures that have been reused from other sources don't fall under this license and can be recognized by a note in their caption: "Figure from ...".

    Citation

    For attribution, please cite this work as

    Anoke, et al., "The R Journal: xgrid and R: Parallel Distributed Processing Using Heterogeneous Groups of Apple Computers", The R Journal, 2012

    BibTeX citation

    @article{RJ-2012-006,
      author = {Anoke, Sarah C. and Zhao, Yuting and Jaeger, Rafael and Horton, Nicholas J.},
      title = {The R Journal: xgrid and R: Parallel Distributed Processing Using Heterogeneous Groups of Apple Computers},
      journal = {The R Journal},
      year = {2012},
      note = {https://doi.org/10.32614/RJ-2012-006},
      doi = {10.32614/RJ-2012-006},
      volume = {4},
      issue = {1},
      issn = {2073-4859},
      pages = {45-55}
    }