Thesis Defense: Advances in Hierarchical Probabilistic Multimodal Data Fusion

Speaker: Christopher L. Dean , CSAIL MIT

Date: Monday, April 25, 2022

Time: 1:00 PM to 2:00 PM Note: all times are in the Eastern Time Zone

Public: Yes

Location: 32-G449 (Patil/Kiva Seminar Room)

Event Type: Thesis Defense

Room Description:

Host: John W. Fisher III, CSAIL MIT

Contact: Christopher L. Dean, cdean@csail.mit.edu

Relevant URL:

Speaker URL: None

Speaker Photo:
None

Reminders to: seminars@csail.mit.edu

Reminder Subject: TALK: Thesis Defense: Advances in Hierarchical Probabilistic Multimodal Data Fusion

Zoom Link: https://mit.zoom.us/j/97378131815?pwd=ckJydTdob2kzQ1hGZkpxWENONFpOQT09

Abstract:
Multimodal data fusion is the process of integrating disparate data sources into a shared representation suitable for complex reasoning. As a result, one can make more precise inferences about the underlying phenomenon than is possible with each data source used in isolation. In the thesis we adopt a Bayesian view of multimodal data fusion, which formulates reasoning as posterior inference over latent variables. Within the Bayesian setting we present a novel method for data integration that we call Lightweight Data Fusion (LDF). LDF addresses the case where the forward model for a subset of the data sources is unknown or poorly characterized. LDF leverages the remaining data sources to learn an inverse model suitable for posterior inference that combines both types of data. Additionally, we develop a multimodal extension to hierarchical Dirichlet processes (mmHDPs) where, in contrast to the setting for LDF, we lack observation-level correspondences across modalities and the data arise from an implicit latent variable model. Finally, we develop a novel representation for Dirichlet process and HDP mixture models that enables parallelization during inference and extends to more complex models including mmHDPs.

Thesis Committee: John W. Fisher III (MIT), Tamara Broderick (MIT), Jason L. Pacheco (University of Arizona)

Research Areas:
AI & Machine Learning

Impact Areas:

This event is not part of a series.

Created by Christopher L. Dean at Sunday, April 24, 2022 at 4:03 PM.