Thesis Defense - Julian Straub - Nonparametric Directional Perception

Speaker: Julian Straub , CSAIL

Date: Friday, March 24, 2017

Time: 1:00 PM to 2:00 PM Note: all times are in the Eastern Time Zone

Public: Yes

Location: 32-G449 (Kiva)

Event Type:

Room Description:

Host: John W. Fisher III, John J. Leonard, CSAIL

Contact: Julian Straub, jstraub@csail.mit.edu

Relevant URL:

Speaker URL: None

Speaker Photo:
None

Reminders to:

Reminder Subject: TALK: Thesis Defense - Julian Straub - Nonparametric Directional Perception

Artificial perception systems, like autonomous cars and augmented reality headsets, rely on dense 3D sensing technology such as RGB-D cameras and LiDAR scanners. Due to the structural simplicity of man-made environments, understanding and leveraging not only the 3D data but also the local orientations of the constituent surfaces, has huge potential. From an indoor scene to large-scale urban environments, a large fraction of the surfaces can be described by just a few planes with even fewer different normal directions. This sparsity is evident in the surface normal distributions, which exhibit a small number of concentrated clusters. In this work, I draw a rigorous connection between surface normal distributions and 3D structure, and explore this connection in light of different environmental assumptions to further 3D perception. Specifically, I propose the concepts of the Manhattan Frame and the unconstrained directional segmentation. These capture, in the space of surface normals, scenes composed of multiple Manhattan Worlds and more general Stata Center Worlds, in which the orthogonality assumption of the Manhattan World is not applicable. This exploration is theoretically founded in Bayesian nonparametric models, which capture two key properties of the 3D sensing process of an artificial perception system: (1) the inherent sequential nature of data acquisition and (2) that the required model complexity grows with the amount of observed data. The inference algorithms I derive herein inherently exploit and respect these properties. The fundamental insights gleaned from the connection between surface normal distributions and 3D structure lead to practical advances in scene segmentation, drift-free rotation estimation, global point cloud registration and real-time direction-aware 3D reconstruction to aid artificial perception systems.

Advisors: John W. Fisher III, John J. Leonard
Committee: Leslie Kaelbling, Frank Dellaert

Research Areas:

Impact Areas:

This event is not part of a series.

Created by Julian Straub at Wednesday, March 15, 2017 at 10:54 AM.