Embodied Intelligence

An exploration of embodied visual exploration
An exploration of embodied visual exploration

May 2021

Emergence of exploratory look-around behaviors through active observation completion
Emergence of exploratory look-around behaviors through active observation completion

May 2019

End-to-end policy learning for active visual categorization
End-to-end policy learning for active visual categorization

Active visual perception with realistic and complex imagery can be formulated as an end-to-end reinforcement learning problem, the solution to which benefits from additionally exploiting the auxiliary task of action-conditioned future prediction.

July 2018

Learning to look around: Intelligently exploring unseen environments for unknown tasks
Learning to look around: Intelligently exploring unseen environments for unknown tasks

Task-agnostic visual exploration policies may be trained through a proxy "observation completion" task that requires an agent to "paint" unobserved views given a small set of observed views.

June 2018

Learning Image Representations Tied to Egomotion from Unlabeled Video
Learning Image Representations Tied to Egomotion from Unlabeled Video

An agent's continuous visual observations include information about how the world responds to its actions. This can provide an effective source of self-supervision for learning visual representations.

December 2017

Embodied learning for visual recognition
Embodied learning for visual recognition

January 2017

Look-ahead before you leap: end-to-end active recognition by forecasting the effect of motion
Look-ahead before you leap: end-to-end active recognition by forecasting the effect of motion

Active visual perception with realistic and complex imagery can be formulated as an end-to-end reinforcement learning problem, the solution to which benefits from additionally exploiting the auxiliary task of action-conditioned future prediction.

September 2016

Slow and steady feature analysis: higher order temporal coherence in video
Slow and steady feature analysis: higher order temporal coherence in video

Assuming a world that mostly changes smoothly, continuous video streams entail implicit supervision that can be effectively exploited for learning visual representations.

June 2016

Learning image representations tied to ego-motion
Learning image representations tied to ego-motion

An agent's continuous visual observations include information about how the world responds to its actions. This can provide an effective source of self-supervision for learning visual representations.

October 2015