Thesis Defense: Advances in Hierarchical Probabilistic Multimodal Data Fusion
Christopher L. Dean
, CSAIL MIT
Date: Monday, April 25, 2022
Time: 1:00 PM to 2:00 PM Note: all times are in the Eastern Time Zone
Location: 32-G449 (Patil/Kiva Seminar Room)
Event Type: Thesis Defense
Host: John W. Fisher III, CSAIL MIT
Contact: Christopher L. Dean, firstname.lastname@example.org
Speaker URL: None
TALK: Thesis Defense: Advances in Hierarchical Probabilistic Multimodal Data Fusion
Zoom Link: https://mit.zoom.us/j/97378131815?pwd=ckJydTdob2kzQ1hGZkpxWENONFpOQT09
Multimodal data fusion is the process of integrating disparate data sources into a shared representation suitable for complex reasoning. As a result, one can make more precise inferences about the underlying phenomenon than is possible with each data source used in isolation. In the thesis we adopt a Bayesian view of multimodal data fusion, which formulates reasoning as posterior inference over latent variables. Within the Bayesian setting we present a novel method for data integration that we call Lightweight Data Fusion (LDF). LDF addresses the case where the forward model for a subset of the data sources is unknown or poorly characterized. LDF leverages the remaining data sources to learn an inverse model suitable for posterior inference that combines both types of data. Additionally, we develop a multimodal extension to hierarchical Dirichlet processes (mmHDPs) where, in contrast to the setting for LDF, we lack observation-level correspondences across modalities and the data arise from an implicit latent variable model. Finally, we develop a novel representation for Dirichlet process and HDP mixture models that enables parallelization during inference and extends to more complex models including mmHDPs.
Thesis Committee: John W. Fisher III (MIT), Tamara Broderick (MIT), Jason L. Pacheco (University of Arizona)
AI & Machine Learning
Created by Christopher L. Dean at Sunday, April 24, 2022 at 4:03 PM.