Compilers for Machine Learning

3rd C4ML workshop, at CGO 2021

Sunday, February 28, 2021

Online - Join us on Whova (registration required) with Zoom video-conferencing and Gather for social interactions and small group discussions


Machine learning applications are becoming ubiquitous in large-scale production systems. With that growth and the scaling in data volume and model complexity, the focus on efficiently executing machine learning models has become even greater. The push for increased energy efficiency has led to the emergence of diverse heterogeneous system and accelerator architectures. In parallel, model complexity and diversity pushed for higher productivity systems, more powerful programming abstractions, type systems, language embeddings, frameworks and libraries. Compilers have historically been the bridge between programmer efficiency and high performance code, allowing the expression of code that remains understandable and productive to port and extend, while producing high-performance code for diverse architectures. As such, compiler techniques have been increasingly incorporated into machine learning frameworks. This goes both ways: given the broadening gap between high-level constructs and hardware accelerators, compilers in machine learning frameworks also emerged as natural clients of machine learning techniques, from domain-specific heuristics to autotuning.

This workshop aims to highlight cutting edge work and research that incorporate compiler techniques and algorithms in optimizing machine learning workloads. Compiler techniques affect a large part of the machine learning stack. The workshop topics span from high-level abstract representations to code generation for accelerators. The list of invited speakers are similarly experts across the different levels of the stack. The workshop does not have formal proceedings, and presentations will include ample time for interaction.


The workshop features presentations from leading ML compiler experts from academia and industry. Presentations are grouped into 4 sessions, 2 in the morning and 2 in the late afternoon, to accomodate for attendees and speakers reaching out from all over the world.

All times below are displayed in the Eastern Time zone (EST, UTC-5).

09:00 - Gather space opens for 24h

09:20-09:30 - Opening

09:30-11:00 - Session 1 - Chaired by Albert Cohen, Google

30' Break - Virtual coffee/tea on Gather

11:30-13:00 - Session 2 - Chaired by Ayal Zaks, Intel and Technion

4h Break - Virtual lunch/dinner on Gather 

17:00-18:30 - Session 3 - Chaired by Tatiana Shpeisman, Google

30' Break - Virtual coffee/tea on Gather

19:00-20:30 - Session 4 - Chaired by Jacques Pienaar, Google

20:30 - Closing - Gather space remains open for 12h