Dinesh Jayaraman
Open Menu
Close Menu
Home
Research Group
Publications
Teaching
Xin Yang
,
Freddy Yifei Liu
,
Yunshuang Li
,
Yao Gong
,
Dinesh Jayaraman
,
Omid Abari
,
Mingmin Zhao
.
Motion Capture with Millimeter-Wave Tags
.
SenSys
, 2026.
PDF
Christopher Watson
,
Arjun Krishna
,
Dinesh Jayaraman
,
Rajeev Alur
.
Let it Cook: Learning to Wait in Sequential Decision Making
.
Reinforcement Learning Conference (RLC)
, 2026.
Yuyang Liu
,
Chuan Wen
,
Yihang Hu
,
Dinesh Jayaraman
,
Yang Gao
.
TimeRewarder: Learning Dense Reward from Passive Videos via Frame-wise Temporal Distance
.
ICML
, 2026.
π ICML 2026 Spotlight
PDF
Jianing Qian
,
Qinhe Peng
,
Emmanuel Panov
,
Leonor Fermoselle
,
Dinesh Jayaraman*
,
Bernadette Bucher*
,
Tarik Kelestemur*
.
Expanding Spatial and Temporal Context for Robotic Imitation Learning Policies With Scene Graphs
.
CVPR
, 2026.
PDF
George Jiayuan Gao
,
Tianyu Li
,
Junyao Shi
,
Yihan Li
,
Zizhe Zhang
,
Nadia Figueroa
,
Dinesh Jayaraman
.
VLMgineer: Vision-Language Models as Robotic Toolsmiths
.
ICLR
, 2026.
PDF
William Liang
,
Sam Wang
,
Hung-Ju Wang
,
Osbert Bastani
,
Yecheng Jason Ma
,
Dinesh Jayaraman
.
Correspondence-Driven Trajectory Warping for Data-Efficient Imitation and Autonomous Play
.
ICLR
, 2026.
PDF
William Shen
,
Nishanth Kumar
,
Sahit Chintalapudi
,
Jie Wang
,
Christopher Watson
,
Edward Hu
,
Jing Cao
,
Dinesh Jayaraman
,
Leslie Pack Kaelbling
,
TomΓ‘s Lozano-PΓ©rez
.
TiPToP: A Modular Open-Vocabulary Planning System for Robotic Manipulation
.
arXiv preprint arXiv:2603.09971
, 2026.
PDF
Yunzhou Song
,
Long Le
,
Yong-Hyun Park
,
Jie Wang
,
Junyao Shi
,
Lingjie Liu
,
Jiatao Gu
,
Eric Eaton
,
Dinesh Jayaraman
,
Kostas Daniilidis
.
OmniGuide: Universal Guidance Fields for Enhancing Generalist Robot Policies
. 2026.
PDF
Junyao Shi
,
Rujia Yang
,
Kaitian Chao
,
Selina Bingqing Wan
,
Yifei Shao
,
Jiahui Lei
,
Jianing Qian
,
Long Le
,
Pratik Chaudhari
,
Kostas Daniilidis
,
Chuan Wen
,
Dinesh Jayaraman
.
Maestro: Orchestrating Robotics Modules with Vision-Language Models for Zero-Shot Generalist Robots
.
(Under review)
, 2026.
PDF
Edward S. Hu
,
Jie Wang
,
Xingfang Yuan
,
Fiona Luo
,
Muyao Li
,
Gaspard Lambrechts
,
Oleh Rybkin
,
Dinesh Jayaraman
.
Real-World Reinforcement Learning of Interactive Perception Behaviors
.
NeurIPS
, 2025.
PDF
Pranav Atreya et al.
(large collaboration)
.
RoboArena: Distributed Real-World Evaluation of Generalist Robot Policies
.
CORL
, 2025.
π Oral Presentation
PDF
Kaustubh Sridhar
,
Souradeep Dutta
,
Dinesh Jayaraman
,
Insup Lee
.
RICL: Adding In-Context Adaptability to Pre-Trained Vision-Language-Action Models
.
CORL
, 2025.
PDF
Pratik Kunapuli
,
Jake Welde
,
Dinesh Jayaraman
,
Vijay Kumar
.
Leveling the Playing Field: Carefully Comparing Classical and Learned Controllers for Quadrotor Trajectory Tracking
.
RSS
, 2025.
PDF
Junyao Shi*
,
Zhuolun Zhao*
,
Tianyou Wang
,
Ian Pedroza
,
Amy Luo
,
Jie Wang
,
Jason Ma
,
Dinesh Jayaraman
.
ZeroMimic: Distilling Robotic Manipulation Skills from Web Videos
.
ICRA
, 2025.
π Best Paper, Workshop on 3D Vision Language Models for Robotic Manipulation at CVPR 2025
PDF
Jake Welde*
,
Nishanth Rao*
,
Pratik Kunapuli*
,
Dinesh Jayaraman
,
Vijay Kumar
.
Leveraging Symmetry to Accelerate Learning of Trajectory Tracking Controllers for Free-Flying Robotic Systems
.
ICRA
, 2025.
π Best Paper Award in the Neuroscience and Interpretability track, NeurReps Workshop at NeurIPS 2024
PDF
Yecheng Jason Ma et al.
(large collaboration)
.
Vision Language Models are In-Context Value Learners
.
ICLR
, 2025.
PDF
Arjun Krishna
,
Edward S. Hu
,
Dinesh Jayaraman
.
The Value of Sensory Information to a Robot
.
ICLR
, 2025.
PDF
Kaustubh Sridhar
,
Souradeep Dutta
,
Dinesh Jayaraman
,
Insup Lee
.
REGENT: A Retrieval-Augmented Generalist Agent That Can Act In-Context in New Environments
.
ICLR
, 2025.
π Oral Presentation, 1.82% accept rate
PDF
Edward S. Hu
,
Kwangjun Ahn
,
Qinghua Liu
,
Haoran Xu
,
Manan Tomar
,
Ada Langford
,
Dinesh Jayaraman
,
Alex Lamb
,
John Langford
.
Learning to Achieve Goals with Belief State Transformers
.
ICLR
, 2025.
PDF
Long Le
,
Jason Xie
,
William Liang
,
Hung-Ju Wang
,
Yue Yang
,
Yecheng Jason Ma
,
Kyle Vedder
,
Arjun Krishna
,
Dinesh Jayaraman
,
Eric Eaton
.
Articulate-Anything: Automatic Modeling of Articulated Objects via a Vision-Language Foundation Model
.
ICLR
, 2025.
PDF
Christopher Watson
,
Arjun Krishna
,
Rajeev Alur
,
Dinesh Jayaraman
.
Illustrated Landmark Graphs for Long-Horizons Policy Learning
.
TMLR
, 2025.
PDF
Junyao Shi
,
Joshua Smith
,
Jianing Qian
,
Dinesh Jayaraman
.
Points2Reward: Robotic Manipulation Rewards from Just One Video
.
(Under review)
, 2025.
PDF
Long Le
,
Ryan Lucas
,
Chen Wang
,
Chuhao Chen
,
Dinesh Jayaraman
,
Eric Eaton
,
Lingjie Liu
.
Pixie: Fast and Generalizable Supervised Learning of 3D Physics from Pixels
.
arXiv preprint arXiv:2508.17437
, 2025.
PDF
Jianing Qian
,
Bernadette Bucher
,
Dinesh Jayaraman
.
Task-Oriented Hierarchical Object Decomposition for Visuomotor Control
.
CORL
, 2024.
PDF
William Liang
,
Sam Wang
,
Hungju Wang
,
Osbert Bastani
,
Dinesh Jayaraman*
,
Yecheng Jason Ma*
.
Environment Curriculum Generation via Large Language Models
.
CORL
, 2024.
π Oral Presentation
PDF
Weilin Wan
,
Zhiyang Dou
,
Taku Komura
,
Wenping Wang
,
Dinesh Jayaraman
,
Lingjie Liu
.
TLControl: Trajectory and Language Control for Human Motion Synthesis
.
ECCV
, 2024.
PDF
Yinsen Jia
,
Jingxi Xu
,
Dinesh Jayaraman
,
Shuran Song
.
Learning a Meta-Controller for Dynamic Grasping
.
CASE
, 2024.
PDF
Alexander Khazatsky et al.
(large collaboration)
.
DROID: A Large-Scale In-The-Wild Robot Manipulation Dataset
.
RSS
, 2024.
PDF
Yecheng Jason Ma
,
William Liang
,
Hungju Wang
,
Sam Wang
,
Yuke Zhu
,
Linxi Fan
,
Osbert Bastani
,
Dinesh Jayaraman
.
DrEureka: Language Model Guided Sim-To-Real Transfer
.
RSS
, 2024.
PDF
Zichen Zhang
,
Yunshuang Li
,
Osbert Bastani
,
Abhishek Gupta
,
Dinesh Jayaraman
,
Yecheng Jason Ma
,
Luca Weihs
.
Universal Visual Decomposer: Long-Horizon Manipulation Made Easy
.
ICRA
, 2024.
π Best Paper, CORL 2023 Workshop on Learning Effective Abstractions for Planning; Best Paper Finalist at ICRA 2024
PDF
Jianing Qian
,
Anastasios Panagopoulos
,
Dinesh Jayaraman
.
Recasting Generic Pretrained Vision Transformers As Object-Centric Scene Encoders For Manipulation Policies
.
ICRA
, 2024.
PDF
Large Collaboration
.
Open X-Embodiment: Robotic Learning Datasets and RT-X Models
.
ICRA
, 2024.
PDF
Sriram Narayanan
,
Dinesh Jayaraman
,
Manmohan Chandraker
.
Long-HOT: A Modular Hierarchical Approach for Long-Horizon Object Transport
.
ICRA
, 2024.
PDF
Junyao Shi*
,
Jianing Qian*
,
Yecheng Jason Ma
,
Dinesh Jayaraman
.
Composing Pre-Trained Object-Centric Representations for Robotics From βWhatβ and βWhereβ Foundation Models
.
ICRA
, 2024.
PDF
Kyle Vedder
,
Neehar Peri
,
Nathaniel Chodosh
,
Ishan Khatri
,
Eric Eaton
,
Dinesh Jayaraman
,
Yang Liu
,
Deva Ramanan
,
James Hays
.
ZeroFlow: Fast Zero Label Scene Flow via Distillation
.
ICLR
, 2024.
PDF
Edward Hu
,
James Springer
,
Oleh Rybkin
,
Dinesh Jayaraman
.
Privileged Sensing Scaffolds Reinforcement Learning
.
ICLR
, 2024.
π Spotlight Presentation, 5% accept rate
PDF
Kaustubh Sridhar
,
Souradeep Dutta
,
Dinesh Jayaraman
,
James Weimer
,
Insup Lee
.
Memory-Consistent Neural Networks for Imitation Learning
.
ICLR
, 2024.
PDF
Yecheng Jason Ma
,
William Liang
,
Guanzhi Wang
,
De-an Huang
,
Osbert Bastani
,
Dinesh Jayaraman
,
Yuke Zhu
,
Linxi Fan
,
Anima Anandkumar
.
Eureka: Human-Level Reward Design via Coding Large Language Models
.
ICLR
, 2024.
PDF
Chuan Wen
,
Dinesh Jayaraman
,
Yang Gao
.
Can Transformers Capture Spatial Relations between Objects?
.
ICLR
, 2024.
PDF
Menachem Stern
,
Sam Dillavou
,
Dinesh Jayaraman
,
Douglas J Durian
,
Andrea J Liu
.
Training self-learning circuits for power-efficient solutions
.
Applied Physics Letters (APL) Machine Learning
, 2024.
PDF
Leon Kim
,
Yunshuang Li
,
Michael Posa
,
Dinesh Jayaraman
.
Vision-Based Contact Localization Without Touch or Force Sensing
.
CORL
, 2023.
PDF
Ashwin De Silva et al.
(large collaboration)
.
Prospective Learning: Principled Extrapolation to the Future
.
Proceedings of The 2nd Conference on Lifelong Learning Agents
, 2023.
PDF
Yecheng Jason Ma
,
Vikash Kumar
,
Amy Zhang
,
Osbert Bastani
,
Dinesh Jayaraman
.
LIV: Language-Image Representations and Rewards for Robotic Control
.
ICML
, 2023.
PDF
Yecheng Jason Ma
,
Kausik Sivakumar
,
Jason Yen
,
Osbert Bastani
,
Dinesh Jayaraman
.
Learning Policy-Aware Models for Model-Based Reinforcement Learning via Transition Occupancy Matching
.
L4DC
, 2023.
PDF
Yecheng Jason Ma
,
Shagun Sodhani
,
Dinesh Jayaraman
,
Osbert Bastani
,
Vikash Kumar
,
Amy Zhang
.
VIP: Towards Universal Visual Reward and Representation via Value-Implicit Pre-Training
.
ICLR
, 2023.
π Spotlight Presentation, 5% accept rate
PDF
Edward Hu
,
Richard Chang
,
Oleh Rybkin
,
Dinesh Jayaraman
.
Planning Goals for Exploration
.
ICLR
, 2023.
π Spotlight Presentation, 5% accept rate; Best Paper Award, CoRL 2022 Roboadapt Workshop
PDF
Kun Huang
,
Edward Hu
,
Dinesh Jayaraman
.
Training Robots to Evaluate Robots: Example-Based Interactive Reward Functions for Policy Learning
.
CORL
, 2022.
π Oral Presentation; Best Paper Award at CORL 2022
PDF
Yecheng Jason Ma
,
Jason Yan
,
Dinesh Jayaraman
,
Osbert Bastani
.
How Far I'll Go: Offline Goal-Conditioned Reinforcement Learning via $ f $-Advantage Regression
.
NeurIPS
, 2022.
π Nominated for Outstanding Paper Award at NeurIPS 2022
PDF
Jianing Qian
,
Anastasios Panagopoulos
,
Dinesh Jayaraman
.
Discovering Deformable Keypoint Pyramids
.
ECCV
, 2022.
PDF
Yecheng Jason Ma
,
Andrew Shen
,
Dinesh Jayaraman
,
Osbert Bastani
.
SMODICE: Versatile Offline Imitation Learning via State Occupancy Matching
.
ICML
, 2022.
PDF
Chuan Wen
,
Jianing Qian
,
Jierui Lin
,
Jiaye Teng
,
Dinesh Jayaraman
,
Yang Gao
.
Fighting Fire with Fire: Avoiding DNN Shortcuts through Priming
.
ICML
, 2022.
PDF
Edward S. Hu
,
Kun Huang
,
Oleh Rybkin
,
Dinesh Jayaraman
.
Know Thyself: Transferable Visuomotor Control Through Robot-Awareness
.
ICLR
, 2022.
PDF
Yecheng Jason Ma
,
Andrew Shen
,
Osbert Bastani
,
Dinesh Jayaraman
.
Conservative and Adaptive Penalty for Model-Based Safe Reinforcement Learning
.
AAAI
, 2022.
PDF
Joshua T Vogelstein et al.
(large collaboration)
.
Prospective Learning: Back to the Future
. 2022.
PDF
Jianing Qian
,
Dinesh Jayaraman
.
Object Representations Guided By Optical Flow
.
NeurIPS 4th Robot Learning Workshop: Self-Supervised and Lifelong Learning
, 2021.
PDF
Yecheng Jason Ma
,
Dinesh Jayaraman
,
Osbert Bastani
.
Conservative Offline Distributional Reinforcement Learning
.
NeurIPS
, 2021.
PDF
Yecheng Jason Ma
,
Jeevana Priya Inala
,
Dinesh Jayaraman
,
Osbert Bastani
.
Likelihood-Based Diverse Sampling for Trajectory Forecasting
.
ICCV
, 2021.
PDF
Nikos Kolotouros
,
Georgios Pavlakos
,
Dinesh Jayaraman
,
Kostas Daniilidis
.
Embracing the Reconstruction Uncertainty in 3D Human Pose Estimation
.
ICCV
, 2021.
PDF
Chuan Wen
,
Jierui Lin
,
Jianing Qian
,
Yang Gao
,
Dinesh Jayaraman
.
Keyframe-focused visual imitation learning
.
ICML
, 2021.
PDF
Jingxi Xu
,
Bruce Lee
,
Nikolai Matni
,
Dinesh Jayaraman
.
How Are Learned Perception-Based Controllers Impacted by the Limits of Robust Control?
.
L4DC
, 2021.
PDF
Santhosh K Ramakrishnan
,
Dinesh Jayaraman
,
Kristen Grauman
.
An exploration of embodied visual exploration
.
IJCV
, 2021.
Glen Berseth
,
Daniel Geng
,
Coline Devin
,
Chelsea Finn
,
Dinesh Jayaraman
,
Sergey Levine
.
SMiRL: Surprise Minimizing RL in Dynamic Environments
.
ICLR
, 2021.
π Oral Presentation
PDF
Hui Chen et al.
(large collaboration)
.
Femtomolar SARS-CoV-2 Antigen Detection Using the Microbubbling Digital Assay with Smartphone Readout Enables Antigen Burden Quantitation and Dynamics Tracking
.
medRxiv
, 2021.
PDF
Karl Pertsch
,
Oleh Rybkin
,
Frederik Ebert
,
Dinesh Jayaraman
,
Chelsea Finn
,
Sergey Levine
.
Long-horizon visual planning with goal-conditioned hierarchical predictors
.
NeurIPS
, 2020.
PDF
Chuan Wen
,
Jierui Lin
,
Trevor Darrell
,
Dinesh Jayaraman
,
Yang Gao
.
Fighting Copycat Agents in Behavioral Cloning from Observation Histories
.
NeurIPS
, 2020.
PDF
Neha Das
,
Sarah Bechtle
,
Todor Davchev
,
Dinesh Jayaraman
,
Akshara Rai
,
Franziska Meier
.
Model-Based Inverse Reinforcement Learning from Visual Demonstrations
.
CORL
, 2020.
PDF
Jesse Zhang
,
Brian Cheung
,
Chelsea Finn
,
Sergey Levine
,
Dinesh Jayaraman
.
Cautious adaptation for reinforcement learning in safety-critical settings
.
ICML
, 2020.
PDF
Brian Yang*
,
Dinesh Jayaraman*
,
Glen Berseth
,
Alexei Efros
,
Sergey Levine
.
MAVRIC: Morphology-Agnostic Visual Robotic Control
.
ICRA and IEEE RA-L
, 2020.
PDF
Mike Lambeta
,
Po-Wei Chou
,
Stephen Tian
,
Brian Yang
,
Benjamin Maloon
,
Victoria Rose Most
,
Dave Stroud
,
Raymond Santos
,
Ahmad Byagowi
,
Gregg Kammerer
,
Dinesh Jayaraman
,
Roberto Calandra
.
Digit: A novel design for a low-cost compact high-resolution tactile sensor with application to in-hand manipulation
.
ICRA and IEEE RA-L
, 2020.
PDF
Pim De Haan
,
Dinesh Jayaraman
,
Sergey Levine
.
Causal Confusion in Imitation Learning
.
NeurIPS
, 2019.
PDF
Brian Yang
,
Dinesh Jayaraman
,
Jesse Zhang
,
Sergey Levine
.
REPLAB: A reproducible low-cost arm benchmark for robotic learning
.
ICRA
, 2019.
PDF
Stephen Tian
,
Frederik Ebert
,
Dinesh Jayaraman
,
Mayur Mudigonda
,
Chelsea Finn
,
Roberto Calandra
,
Sergey Levine
.
Manipulation by feel: Touch-based control with deep predictive models
.
ICRA
, 2019.
PDF
Santhosh K Ramakrishnan*
,
Dinesh Jayaraman*
,
Kristen Grauman
.
Emergence of exploratory look-around behaviors through active observation completion
.
Science Robotics
, 2019.
PDF
Dinesh Jayaraman
,
Frederik Ebert
,
Alexei a Efros
,
Sergey Levine
.
Time-agnostic prediction: Predicting predictable video frames
.
ICLR
, 2019.
PDF
Roberto Calandra
,
Andrew Owens
,
Dinesh Jayaraman
,
Justin Lin
,
Wenzhen Yuan
,
Jitendra Malik
,
Edward H Adelson
,
Sergey Levine
.
More Than a Feeling: Learning to Grasp and Regrasp using Vision and Touch
.
IROS and IEEE RA-L
, 2018.
π Best Paper Award Runner-Up, IEEE Robotics and Automation-Letters (RA-L) 2018
PDF
Dinesh Jayaraman
,
Ruohan Gao
,
Kristen Grauman
.
Shapecodes: self-supervised feature learning by lifting views to viewgrids
.
ECCV
, 2018.
PDF
Dinesh Jayaraman
,
Kristen Grauman
.
End-to-end policy learning for active visual categorization
.
IEEE TPAMI
, 2018.
PDF
Dinesh Jayaraman
,
Kristen Grauman
.
Learning to look around: Intelligently exploring unseen environments for unknown tasks
.
CVPR
, 2018.
PDF
Tao Ma
,
Wei Sun
,
Oscar Nestares
,
Kalpana Seshadrinathan
,
Dinesh Jayaraman
.
Techniques for rectification of camera arrays
. 2018.
PDF
Dinesh Jayaraman
,
Kristen Grauman
.
Learning Image Representations Tied to Egomotion from Unlabeled Video
.
IJCV Special Issue of Best Papers from ICCV 2015
, 2017.
PDF
Oscar Nestares
,
Kalpana Seshadrinathan
,
Dinesh Jayaraman
.
Techniques for improved focusing of camera arrays
. 2017.
PDF
Dinesh Jayaraman
.
Embodied learning for visual recognition
. 2017.
PDF
Dinesh Jayaraman
,
Chao-Yeh Chen
,
Fei Sha
,
Kristen Grauman
.
Divide, share, and conquer: Multi-task attribute learning with selective sharing
.
Visual attributes
, 2017.
PDF
Yu-Chuan Su
,
Dinesh Jayaraman
,
Kristen Grauman
.
Pano2Vid: Automatic cinematography for watching 360-degree videos
.
ACCV
, 2016.
π Oral Presentation; Best Application Paper Award at ACCV 2016
PDF
Ruohan Gao
,
Dinesh Jayaraman
,
Kristen Grauman
.
Object-Centric Representation Learning from Unlabeled Videos
.
ACCV
, 2016.
PDF
Dinesh Jayaraman
,
Kristen Grauman
.
Look-ahead before you leap: end-to-end active recognition by forecasting the effect of motion
.
ECCV
, 2016.
π Oral Presentation
PDF
Dinesh Jayaraman
,
Kristen Grauman
.
Slow and steady feature analysis: higher order temporal coherence in video
.
CVPR
, 2016.
π Spotlight Presentation
PDF
Dinesh Jayaraman
,
Kristen Grauman
.
Learning image representations tied to ego-motion
.
ICCV
, 2015.
π Oral Presentation
PDF
Dinesh Jayaraman
,
Kristen Grauman
.
Zero-shot recognition with unreliable attributes
.
NeurIPS
, 2014.
PDF
Dinesh Jayaraman
,
Fei Sha
,
Kristen Grauman
.
Decorrelating semantic visual attributes by resisting the urge to share
.
CVPR
, 2014.
π Oral Presentation
PDF
Dinesh Jayaraman
,
Anish Mittal
,
Anush K Moorthy
,
Alan C Bovik
.
Objective quality assessment of multiply distorted images
.
ASILOMAR Signals, Systems and Computers
, 2012.
PDF