Utilizing Eye Tracking to build better AI in Radiology

Speaker: Satyananda Kashyap , IBM Research - Almaden Research Center, San Jose, CA, USA

Date: Monday, May 09, 2022

Time: 1:30 PM to 2:30 PM Note: all times are in the Eastern Time Zone

Public: No

Location: 32-D507

Event Type: Seminar

Room Description:

Host: Polina Golland, CSAIL MIT

Contact: Sheila Sharbetian, sheilash@csail.mit.edu

Relevant URL:

Speaker URL: None

Speaker Photo:
None

Reminders to: seminars@csail.mit.edu

Reminder Subject: TALK: Utilizing Eye Tracking to build better AI in Radiology

Abstract:
In this talk I will present our initial data collection and experiments in using eye-gaze in radiology. We developed a rich dataset of Chest X-Ray (CXR) images to assist investigators in artificial intelligence. The data were collected using an eye-tracking system while a radiologist reviewed and reported on 1,083 CXR images. The dataset contains the following aligned data: CXR image, transcribed radiology report text, radiologist’s dictation audio and eye gaze coordinates data. We hope this dataset can contribute to various areas of research particularly towards explainable and multimodal deep learning/ machine learning methods. Furthermore, investigators in disease classification and localization, automated radiology report generation, and human-machine interaction can benefit from these data. We report deep learning experiments that utilize the attention maps produced by the eye gaze dataset to show the potential utility of this dataset.

Research Areas:

Impact Areas:

See other events that are part of the Biomedical Imaging and Analysis 2021 - 2022.

Created by Sheila Sharbetian at Friday, May 06, 2022 at 5:04 PM.