SPLASH 2021
Sun 17 - Fri 22 October 2021 Chicago, Illinois, United States
Thu 21 Oct 2021 13:50 - 14:05 at Zurich C - Implementation of special Paradigms Chair(s): Frank Tip
Thu 21 Oct 2021 21:50 - 22:05 at Zurich C - Implementation of special Paradigms - mirror Chair(s): Steve Blackburn

This paper presents a novel optimization for differentiable programming named coarsening optimization. It offers a systematic way to synergize symbolic differentiation and algorithmic differentiation (AD). Through it, the granularity of the computations differentiated by each step in AD can become much larger than a single operation, and hence lead to much reduced runtime computations and data allocations in AD. To circumvent the difficulties that control flow creates to symbolic differentiation in coarsening, this work introduces phi-calculus, a novel method to allow symbolic reasoning and differentiation of computations that involve branches and loops. It further avoids "expression swell" in symbolic differentiation and balance reuse and coarsening through the design of reuse-centric segment of interest identification. Experiments on a collection of real-world applications show that coarsening optimization is effective in speeding up AD, producing several times to two orders of magnitude speedups.

Thu 21 Oct

Displayed time zone: Central Time (US & Canada) change

13:50 - 15:10
Implementation of special ParadigmsOOPSLA at Zurich C +8h
Chair(s): Frank Tip Northeastern University
13:50
15m
Talk
Coarsening Optimization for Differentiable ProgrammingVirtual
OOPSLA
Xipeng Shen North Carolina State University; Facebook, Guoqiang Zhang North Carolina State University; Facebook, Irene Dea Facebook, Samantha Andow Facebook, Emilio Arroyo-Fang Facebook, Neal Gafter Facebook, Johann George Facebook, Melissa Grueter Facebook, Erik Meijer Facebook, Olin Grigsby Shivers Facebook, Steffi Stumpos Facebook, Alanna Tempest Facebook, Christy Warden Facebook, Shannon Yang Facebook
DOI
14:05
15m
Talk
Efficient Automatic Scheduling of Imaging and Vision Pipelines for the GPUVirtual
OOPSLA
Luke Anderson Massachusetts Institute of Technology, Andrew Adams Adobe, Karima Ma Massachusetts Institute of Technology, Tzu-Mao Li Massachusetts Institute of Technology; University of California at San Diego, Tian Jin Massachusetts Institute of Technology, Jonathan Ragan-Kelley Massachusetts Institute of Technology
DOI
14:20
15m
Talk
Statically Bounded-Memory Delayed Sampling for Probabilistic StreamsIn-Person
OOPSLA
Eric Atkinson Massachusetts Institute of Technology, Guillaume Baudart Inria; ENS; PSL University, Louis Mandel IBM Research, Charles Yuan Massachusetts Institute of Technology, Michael Carbin Massachusetts Institute of Technology
DOI
14:35
15m
Talk
Compilation of Sparse Array Programming ModelsIn-Person
OOPSLA
Rawn Henry Massachusetts Institute of Technology, Olivia Hsu Stanford University, Rohan Yadav Stanford University, Stephen Chou Massachusetts Institute of Technology, Kunle Olukotun Stanford University, Saman Amarasinghe Massachusetts Institute of Technology, Fredrik Kjolstad Stanford University
DOI
14:50
20m
Live Q&A
Discussion, Questions and Answers
OOPSLA

21:50 - 23:10
Implementation of special Paradigms - mirrorOOPSLA at Zurich C
Chair(s): Steve Blackburn Australian National University
21:50
15m
Talk
Coarsening Optimization for Differentiable ProgrammingVirtual
OOPSLA
Xipeng Shen North Carolina State University; Facebook, Guoqiang Zhang North Carolina State University; Facebook, Irene Dea Facebook, Samantha Andow Facebook, Emilio Arroyo-Fang Facebook, Neal Gafter Facebook, Johann George Facebook, Melissa Grueter Facebook, Erik Meijer Facebook, Olin Grigsby Shivers Facebook, Steffi Stumpos Facebook, Alanna Tempest Facebook, Christy Warden Facebook, Shannon Yang Facebook
DOI
22:05
15m
Talk
Efficient Automatic Scheduling of Imaging and Vision Pipelines for the GPUVirtual
OOPSLA
Luke Anderson Massachusetts Institute of Technology, Andrew Adams Adobe, Karima Ma Massachusetts Institute of Technology, Tzu-Mao Li Massachusetts Institute of Technology; University of California at San Diego, Tian Jin Massachusetts Institute of Technology, Jonathan Ragan-Kelley Massachusetts Institute of Technology
DOI
22:20
15m
Talk
Statically Bounded-Memory Delayed Sampling for Probabilistic StreamsIn-Person
OOPSLA
Eric Atkinson Massachusetts Institute of Technology, Guillaume Baudart Inria; ENS; PSL University, Louis Mandel IBM Research, Charles Yuan Massachusetts Institute of Technology, Michael Carbin Massachusetts Institute of Technology
DOI
22:35
15m
Talk
Compilation of Sparse Array Programming ModelsIn-Person
OOPSLA
Rawn Henry Massachusetts Institute of Technology, Olivia Hsu Stanford University, Rohan Yadav Stanford University, Stephen Chou Massachusetts Institute of Technology, Kunle Olukotun Stanford University, Saman Amarasinghe Massachusetts Institute of Technology, Fredrik Kjolstad Stanford University
DOI
22:50
20m
Live Q&A
Discussion, Questions and Answers
OOPSLA