[Colloquium] REMINDER: 4/10 Talks at TTIC: Aishwarya Agrawal, Georgia Tech

[Alicia McClarin]

*When: *   Wednesday, April 10th at 11:00 AM

Where:    TTIC, 6045 S Kenwood Avenue, 5th Floor, Room 526

Who:       Aishwarya Agrawal, Georgia Tech

*Title:*       Visual Question Answering and Beyond

*Abstract:* In this talk, I will present our work on a multi-modal AI task
called Visual Question Answering (VQA) -- given an image and a natural
language question about the image (e.g., “What kind of store is this?”, “Is
it safe to cross the street?”), the machine’s task is to automatically
produce an accurate natural language answer (“bakery”, “yes”). Applications
of VQA include -- aiding visually impaired users in understanding their
surroundings, aiding analysts in examining large quantities of surveillance
data, teaching children through interactive demos, interacting with
personal AI assistants, and making visual social media content more
accessible.

Specifically, I will provide a brief overview of the VQA task, dataset and
baseline models, highlight some of the problems with existing VQA models,
and talk about how to fix some of these problems by proposing -- 1) a new
evaluation protocol,  2) a new model architecture, and 3) a novel objective
function.

Most of my past work has been towards building agents that can ‘see’ and
‘talk’. However, for a lot of practical applications (e.g., physical agents
navigating inside our houses executing natural language commands) we need
agents that can not only ‘see’ and ‘talk’ but can also take actions.
Towards the end of the talk, I will present future directions towards
generalizing vision and language agents to be able to take actions.

*Host: *Greg Shakhnarovich <greg at ttic.edu>

-- 
*Alicia McClarin*
*Toyota Technological Institute at Chicago*
*6045 S. Kenwood Ave., **Office 510*
*Chicago, IL 60637*
*773-702-5370*
*www.ttic.edu* <http://www.ttic.edu/>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.cs.uchicago.edu/pipermail/colloquium/attachments/20190409/f9d9c13d/attachment.html>