Compilers for Machine Learning

5th C4ML workshop, at CGO 2024

Sunday, March 3, 2023

In person: Edinburgh, UK


Machine learning applications are becoming ubiquitous in large-scale production systems. With that growth and the scaling in data volume and model complexity, the focus on efficiently executing machine learning models has become even greater. The push for increased energy efficiency has led to the emergence of diverse heterogeneous system and accelerator architectures. In parallel, model complexity and diversity pushed for higher productivity systems, more powerful programming abstractions, type systems, language embeddings, frameworks and libraries. Compilers have historically been the bridge between programmer efficiency and high performance code, allowing the expression of code that remains understandable and productive to port and extend, while producing high-performance code for diverse architectures. As such, compiler techniques have been increasingly incorporated into machine learning frameworks. This goes both ways: given the broadening gap between high-level constructs and hardware accelerators, compilers in machine learning frameworks also emerged as natural clients of machine learning techniques, from domain-specific heuristics to autotuning.

This workshop aims to highlight cutting edge work and research that incorporates compiler techniques and algorithms with optimizing machine learning workloads. Compiler techniques affect a large part of the machine learning stack. The workshop topics span from high-level abstract representations to code generation for accelerators. The list of invited speakers are similarly experts across the different levels of the stack. The workshop does not have formal proceedings, and presentations will include ample time for interaction.

Preliminary Program

The workshop features 8 presentations from leading ML compiler experts from industry and academia. 6 posters will be displayed at the end of the workshop (together with the main conference's welcome and poster reception), with short talks introducing the posters in the last session.

09:15-09:20 - Opening

09:20-10:00 - Session 1 - Debunking ML for Compilers

10:00-10:20 - Break

10:20-12:20 - Session 2 - ML Compiler Construction

12:20-13:20 - Lunch

13:20-15:20 - Session 3 - Target- and domain-specific optimization

15:20-15:40 - Break 

15:40-16:20 - Session 4 - ML compiler infrastructure for general-purpose computing

16:20-17:20 - Session 5 - Poster Lightning Talks

18:00-20:00 - Poster Reception