*********************************
There is now a CONTENT FREEZE for Mercury while we switch to a new platform. It began on Friday, March 10 at 6pm and will end on Wednesday, March 15 at noon. No new content can be created during this time, but all material in the system as of the beginning of the freeze will be migrated to the new platform, including users and groups. Functionally the new site is identical to the old one. webteam@gatech.edu
*********************************
Title: Using Multi-Relational Embeddings as Knowledge Graph Representations for Robotics Applications
Angel Andres Daruna
Robotics Ph.D. Candidate
School of Electrical and Computer Engineering
Georgia Institute of Technology
Email: adaruna3@gatech.edu
Date: Wednesday May 4th, 2022
Time: 11:00 AM to 1:00 PM ET (UTC-04:00)
Location: https://gatech.zoom.us/my/adaruna3
Committee:
Dr. Sonia Chernova (Advisor) - Georgia Institute of Technology, School of Interactive Computing
Dr. Zsolt Kira - Georgia Institute of Technology, School of Interactive Computing
Dr. Mohan Sridharan - School of Computer Science, University of Birmingham, UK
Dr. Matthew Gombolay - Georgia Institute of Technology, School of Interactive Computing
Dr. Devi Parikh - Georgia Institute of Technology, School of Interactive Computing
Abstract:
User demonstrations of robot tasks in everyday environments, such as households, can be brittle due in part to the dynamic, diverse, and complex properties of those environments. Humans can find solutions in ambiguous or unfamiliar situations by using a wealth of common-sense knowledge about their domains to make informed generalizations. For example, likely locations for food in a novel household. Prior work has shown that robots can benefit from reasoning about this type of semantic knowledge, which can be modeled as a knowledge graph of interrelated facts that define whether a relationship exists between two entities. Semantic reasoning about domain knowledge using knowledge graph representations has improved the robustness and usability of end user robots by enabling more fault tolerant task execution. Knowledge graph representations define the underlying representation of facts, how facts are organized, and implement semantic reasoning by defining the possible computations over facts (e.g. association, fact-prediction). Existing knowledge graph representations used for robots are limited in their ability to scale to large knowledge graphs that model everyday domains, while accounting for fact uncertainty. This dissertation examines whether multi-relational embeddings can be used as representations of semantic domain knowledge to improve the task execution robustness of robots that must reason about fact uncertainty, scale reasoning to model everyday domains, adapt to changes in known facts, and be explainable to end users.
