Differentiable Programming for Machine Learning

Speaker: Martin Abadi and Dougal Maclaurin , Google

Date: Thursday, May 02, 2019

Time: 4:00 PM to 5:00 PM

Public: Yes


Event Type: Seminar

Room Description: 32-D463 (Star)

Host: Michael Carbin

Contact: Nathan Higgins, 617-515-5976, nhiggins@csail.mit.edu

Relevant URL:

Speaker URL: None

Speaker Photo:

Reminders to: pl@lists.csail.mit.edu, g7@csail.mit.edu, g8@csail.mit.edu, g9@csail.mit.edu, csail-related@csail.mit.edu

Reminder Subject: TALK: Differentiable Programming for Machine Learning

The recent successes of machine learning are due in part to the invention of machine learning methods (especially for deep learning), to the collection of datasets for tackling problems in many fields, and to the availability of powerful hardware, including CPUs, GPUs, and custom-designed ASICs. Software systems, however, are central to this progress.
This talk suggests that it is instructive and fruitful to think of these software systems from a programming-language perspective. A system such as TensorFlow owes its power and generality to its programmability. There, models for machine learning are assembled from primitive operations by function composition and other simple, familiar constructs, with in addition support for automatic differentiation, which is uncommon in mainstream programming languages but prominent in current machine learning methods.
The design and the principles of the corresponding programming languages remain active research areas. This talk presents some recent results on the semantics of these languages, focusing on a tiny but expressive language for differentiable programming. It also includes an introduction to JAX, a new system for composable transformations of numerical Python programs, including automatic differentiation and compilation for hardware accelerators.
The talk is based on joint work with many people, in particular Gordon Plotkin and the many contributors to the systems described.

Research Areas:
AI & Machine Learning, Computer Architecture, Programming Languages & Software

Impact Areas:

See other events that are part of the Programming Languages & Software Engineering Seminar 2018-2019.

Created by Nathan Higgins Email at Monday, April 22, 2019 at 1:14 PM.