Statically Bounded-Memory Delayed Sampling for Probabilistic StreamsIn-Person
Thu 21 Oct 2021 22:20 - 22:35 at Zurich C - Implementation of special Paradigms - mirror Chair(s): Steve Blackburn
\emph{Probabilistic programming languages} aid developers performing Bayesian inference. These languages provide programming constructs and tools for probabilistic modeling and automating the process of developing a probabilistic inference procedure. Prior work introduced a probabilistic programming language, ProbZelus, to extend probabilistic programming functionality to unbounded streams of data. A key innovation of ProbZelus was to demonstrate that the \emph{delayed sampling} inference algorithm could be extended to work in a streaming context. ProbZelus showed that while delayed sampling could be effectively deployed on some programs, depending on the probabilistic model under consideration, delayed sampling is not guaranteed to use a bounded amount of memory over the course of the execution of the program.
In this paper, we the present conditions on a probabilistic program’s execution under which delayed sampling will execute in bounded memory. The two conditions are dataflow properties of the core operations of delayed sampling: the \emph{$m$-consumed property} and \emph{the unseparated path property}. A program executes in bounded memory under delayed sampling if, and only if, it satisfies the $m$-consumed and unseparated path properties. We propose a static analysis that abstracts over these properties to soundly ensure that any program that passes the analysis satisfies these properties, and thus executes in bounded memory under delayed sampling.
Thu 21 OctDisplayed time zone: Central Time (US & Canada) change
13:50 - 15:10 | |||
13:50 15mTalk | Coarsening Optimization for Differentiable ProgrammingVirtual OOPSLA Xipeng Shen North Carolina State University; Facebook, Guoqiang Zhang North Carolina State University; Facebook, Irene Dea Facebook, Samantha Andow Facebook, Emilio Arroyo-Fang Facebook, Neal Gafter Facebook, Johann George Facebook, Melissa Grueter Facebook, Erik Meijer Facebook, Olin Grigsby Shivers Facebook, Steffi Stumpos Facebook, Alanna Tempest Facebook, Christy Warden Facebook, Shannon Yang Facebook DOI | ||
14:05 15mTalk | Efficient Automatic Scheduling of Imaging and Vision Pipelines for the GPUVirtual OOPSLA Luke Anderson Massachusetts Institute of Technology, Andrew Adams Adobe, Karima Ma Massachusetts Institute of Technology, Tzu-Mao Li Massachusetts Institute of Technology; University of California at San Diego, Tian Jin Massachusetts Institute of Technology, Jonathan Ragan-Kelley Massachusetts Institute of Technology DOI | ||
14:20 15mTalk | Statically Bounded-Memory Delayed Sampling for Probabilistic StreamsIn-Person OOPSLA Eric Atkinson Massachusetts Institute of Technology, Guillaume Baudart IBM Research, USA, Louis Mandel IBM Research, Charles Yuan Massachusetts Institute of Technology, Michael Carbin Massachusetts Institute of Technology DOI | ||
14:35 15mTalk | Compilation of Sparse Array Programming ModelsIn-Person OOPSLA Rawn Henry Massachusetts Institute of Technology, Olivia Hsu Stanford University, Rohan Yadav Stanford University, Stephen Chou Massachusetts Institute of Technology, Kunle Olukotun Stanford University, Saman Amarasinghe Massachusetts Institute of Technology, Fredrik Kjolstad Stanford University DOI | ||
14:50 20mLive Q&A | Discussion, Questions and Answers OOPSLA |
21:50 - 23:10 | Implementation of special Paradigms - mirrorOOPSLA at Zurich C Chair(s): Steve Blackburn Australian National University | ||
21:50 15mTalk | Coarsening Optimization for Differentiable ProgrammingVirtual OOPSLA Xipeng Shen North Carolina State University; Facebook, Guoqiang Zhang North Carolina State University; Facebook, Irene Dea Facebook, Samantha Andow Facebook, Emilio Arroyo-Fang Facebook, Neal Gafter Facebook, Johann George Facebook, Melissa Grueter Facebook, Erik Meijer Facebook, Olin Grigsby Shivers Facebook, Steffi Stumpos Facebook, Alanna Tempest Facebook, Christy Warden Facebook, Shannon Yang Facebook DOI | ||
22:05 15mTalk | Efficient Automatic Scheduling of Imaging and Vision Pipelines for the GPUVirtual OOPSLA Luke Anderson Massachusetts Institute of Technology, Andrew Adams Adobe, Karima Ma Massachusetts Institute of Technology, Tzu-Mao Li Massachusetts Institute of Technology; University of California at San Diego, Tian Jin Massachusetts Institute of Technology, Jonathan Ragan-Kelley Massachusetts Institute of Technology DOI | ||
22:20 15mTalk | Statically Bounded-Memory Delayed Sampling for Probabilistic StreamsIn-Person OOPSLA Eric Atkinson Massachusetts Institute of Technology, Guillaume Baudart IBM Research, USA, Louis Mandel IBM Research, Charles Yuan Massachusetts Institute of Technology, Michael Carbin Massachusetts Institute of Technology DOI | ||
22:35 15mTalk | Compilation of Sparse Array Programming ModelsIn-Person OOPSLA Rawn Henry Massachusetts Institute of Technology, Olivia Hsu Stanford University, Rohan Yadav Stanford University, Stephen Chou Massachusetts Institute of Technology, Kunle Olukotun Stanford University, Saman Amarasinghe Massachusetts Institute of Technology, Fredrik Kjolstad Stanford University DOI | ||
22:50 20mLive Q&A | Discussion, Questions and Answers OOPSLA |