EECS Special Seminar: Learning-based Learning Systems

Speaker: Tianqi Chen , Unviersity of Washington

Date: Thursday, April 11, 2019

Time: 4:00 PM to 5:00 PM

Public: Yes

Location: 32-G449

Event Type: Seminar

Room Description: Patil/Kiva

Host: Tommi Jaakkola, MIT-CSAIL

Contact: Mary McDavitt, 617-253-9620, mmcdavit@csail.mit.edu

Relevant URL:

Speaker URL: None

Speaker Photo:
None

Reminders to: Seminars@csail.mit.edu

Reminder Subject: TALK: EECS Special Seminar: Learning-based Learning Systems

ABSTRACT
Data, models, and computing are the three pillars that enable machine learning to solve real-world problems at scale. Making progress on these three domains requires not only disruptive algorithmic advances but also systems innovations that can continue to squeeze more efficiency out of modern hardware. Learning systems are in the center of every intelligent application nowadays. However, the ever-growing demand for applications and hardware specialization creates a huge engineering burden for these systems, most of which rely on heuristics or manual optimization.

In this talk, I will present a new approach that uses machine learning to automate system optimizations. I will describe our approach in the context of deep learning deployment problem. I will first discuss how to design invariant representations that can lead to transferable statistical cost models, and apply these representations to optimize tensor programs used in deep learning applications. I will then describe the system improvements we made to enable diverse hardware backends. TVM, our end-to-end system, delivers performance across hardware back-ends that are competitive with state-of-the-art, hand-tuned deep learning frameworks. Finally, I will discuss how to generalize our approach to do full-stack optimization of the model, system, hardware jointly, and how to build systems to support life-long evolution of intelligent applications. Host: Martin Rinard

BIO
Tianqi Chen is a Ph.D. candidate in the Paul G. Allen School of Computer Science & Engineering at the University of Washington, working with Carlos Guestrin on the intersection of machine learning and systems. He has created three major learning systems that are widely adopted: XGBoost, TVM, and MXNet(co-creator). He is a recipient of the Google Ph.D. Fellowship in Machine Learning.

Research Areas:

Impact Areas:

See other events that are part of the EECS Special Seminar Series 2019.

Created by Mary McDavitt Email at Wednesday, April 03, 2019 at 2:14 PM.