GPU-based Parallel Computation Support for Stan

1 Jul 2019  ·  Rok Češnovar, Steve Bronder, Davor Sluga, Jure Demšar, Tadej Ciglarič, Sean Talts, Erik Štrumbelj ·

This paper details an extensible OpenCL framework that allows Stan to utilize heterogeneous compute devices. It includes GPU-optimized routines for the Cholesky decomposition, its derivative, other matrix algebra primitives and some commonly used likelihoods, with more additions planned for the near future. Stan users can now benefit from large speedups offered by GPUs with little effort and without changes to their existing Stan code. We demonstrate the practical utility of our work with two examples - logistic regression and Gaussian Process regression.

PDF Abstract

Categories


Mathematical Software Distributed, Parallel, and Cluster Computing Computation

Datasets


  Add Datasets introduced or used in this paper