Joseph J. Lim

According to our database, Joseph J. Lim authored at least 61 papers between 2007 and 2023.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2023

LiFT: Unsupervised Reinforcement Learning with Foundation Models as Teachers.

Taewook Nam, Juyong Lee, Jesse Zhang, Sung Ju Hwang, Joseph J. Lim, Karl Pertsch

CoRR, 2023

SPRINT: Scalable Policy Pre-Training via Language Instruction Relabeling.

Jesse Zhang, Karl Pertsch, Jiahui Zhang, Joseph J. Lim

CoRR, 2023

Hierarchical Neural Program Synthesis.

Linghan Zhong, Ryan Lindeborg, Jesse Zhang, Joseph J. Lim, Shao-Hua Sun

CoRR, 2023

Efficient Multi-Task Reinforcement Learning via Selective Behavior Sharing.

Grace Zhang, Ayush Jain, Injune Hwang, Shao-Hua Sun, Joseph J. Lim

CoRR, 2023

FurnitureBench: Reproducible Real-World Benchmark for Long-Horizon Complex Manipulation.

Minho Heo, Youngwoon Lee, Doohyun Lee, Joseph J. Lim

Proceedings of the Robotics: Science and Systems XIX, Daegu, 2023

PATO: Policy Assisted TeleOperation for Scalable Robot Data Collection.

Shivin Dass, Karl Pertsch, Hejia Zhang, Youngwoon Lee, Joseph J. Lim, Stefanos Nikolaidis

Proceedings of the Robotics: Science and Systems XIX, Daegu, 2023

Bootstrap Your Own Skills: Learning to Solve New Tasks with Large Language Model Guidance.

Jesse Zhang, Jiahui Zhang, Karl Pertsch, Ziyi Liu, Xiang Ren, Minsuk Chang, Shao-Hua Sun, Joseph J. Lim

Proceedings of the Conference on Robot Learning, 2023

2022

Task-Induced Representation Learning.

Jun Yamada, Karl Pertsch, Anisha Gunjal, Joseph J. Lim

Proceedings of the Tenth International Conference on Learning Representations, 2022

Skill-based Meta-Reinforcement Learning.

Taewook Nam, Shao-Hua Sun, Karl Pertsch, Sung Ju Hwang, Joseph J. Lim

Proceedings of the Tenth International Conference on Learning Representations, 2022

Know Your Action Set: Learning Action Relations for Reinforcement Learning.

Ayush Jain, Norio Kosaka, Kyung-Min Kim, Joseph J. Lim

Proceedings of the Tenth International Conference on Learning Representations, 2022

Skill-based Model-based Reinforcement Learning.

Lucy Xiaoyang Shi, Joseph J. Lim, Youngwoon Lee

Proceedings of the Conference on Robot Learning, 2022

Cross-Domain Transfer via Semantic Skill Imitation.

Karl Pertsch, Ruta Desai, Vikash Kumar, Franziska Meier, Joseph J. Lim, Dhruv Batra, Akshara Rai

Proceedings of the Conference on Robot Learning, 2022

2021

Policy Transfer across Visual and Dynamics Domain Gaps via Iterative Grounding.

Grace Zhang, Linghan Zhong, Youngwoon Lee, Joseph J. Lim

Proceedings of the Robotics: Science and Systems XVII, Virtual Event, July 12-16, 2021., 2021

Learning to Synthesize Programs as Interpretable and Generalizable Policies.

Dweep Trivedi, Jesse Zhang, Shao-Hua Sun, Joseph J. Lim

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Generalizable Imitation Learning from Observation via Inferring Goal Proximity.

Youngwoon Lee, Andrew Szot, Shao-Hua Sun, Joseph J. Lim

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

IKEA Furniture Assembly Environment for Long-Horizon Complex Manipulation Tasks.

Youngwoon Lee, Edward S. Hu, Joseph J. Lim

Proceedings of the IEEE International Conference on Robotics and Automation, 2021

Message Passing Adaptive Resonance Theory for Online Active Semi-supervised Learning.

Taehyeong Kim, Injune Hwang, Hyundo Lee, Hyunseo Kim, Won-Seok Choi, Joseph J. Lim, Byoung-Tak Zhang

Proceedings of the 38th International Conference on Machine Learning, 2021

Demonstration-Guided Reinforcement Learning with Learned Skills.

Karl Pertsch, Youngwoon Lee, Yue Wu, Joseph J. Lim

Proceedings of the Conference on Robot Learning, 8-11 November 2021, London, UK., 2021

Distilling Motion Planner Augmented Policies into Visual Control Policies for Robot Manipulation.

I-Chun Arthur Liu, Shagun Uppal, Gaurav S. Sukhatme, Joseph J. Lim, Peter Englert, Youngwoon Lee

Proceedings of the Conference on Robot Learning, 8-11 November 2021, London, UK., 2021

Adversarial Skill Chaining for Long-Horizon Robot Manipulation via Terminal State Regularization.

Youngwoon Lee, Joseph J. Lim, Anima Anandkumar, Yuke Zhu

Proceedings of the Conference on Robot Learning, 8-11 November 2021, London, UK., 2021

2020

Scaling simulation-to-real transfer by learning a latent space of robot skills.

Ryan Julian, Eric Heiden, Zhanpeng He, Hejia Zhang, Stefan Schaal, Joseph J. Lim, Gaurav S. Sukhatme, Karol Hausman

Int. J. Robotics Res., 2020

Keyframing the Future: Keyframe Discovery for Visual Prediction and Planning.

Karl Pertsch, Oleh Rybkin, Jingyun Yang, Shenghao Zhou, Konstantinos G. Derpanis, Kostas Daniilidis, Joseph J. Lim, Andrew Jaegle

Proceedings of the 2nd Annual Conference on Learning for Dynamics and Control, 2020

Generalization to New Actions in Reinforcement Learning.

Ayush Jain, Andrew Szot, Joseph J. Lim

Proceedings of the 37th International Conference on Machine Learning, 2020

Program Guided Agent.

Shao-Hua Sun, Te-Lin Wu, Joseph J. Lim

Proceedings of the 8th International Conference on Learning Representations, 2020

Learning to Coordinate Manipulation Skills via Skill Behavior Diversification.

Youngwoon Lee, Jingyun Yang, Joseph J. Lim

Proceedings of the 8th International Conference on Learning Representations, 2020

Motion Planner Augmented Reinforcement Learning for Robot Manipulation in Obstructed Environments.

Jun Yamada, Youngwoon Lee, Gautam Salhotra, Karl Pertsch, Max Pflueger, Gaurav S. Sukhatme, Joseph J. Lim, Peter Englert

Proceedings of the 4th Conference on Robot Learning, 2020

Accelerating Reinforcement Learning with Learned Skill Priors.

Karl Pertsch, Youngwoon Lee, Joseph J. Lim

Proceedings of the 4th Conference on Robot Learning, 2020

2019

IKEA Furniture Assembly Environment for Long-Horizon Complex Manipulation Tasks.

Youngwoon Lee, Edward S. Hu, Zhengyu Yang, Alex Yin, Joseph J. Lim

CoRR, 2019

KeyIn: Discovering Subgoal Structure with Keyframe-based Video Prediction.

Karl Pertsch, Oleh Rybkin, Jingyun Yang, Konstantinos G. Derpanis, Joseph J. Lim, Kostas Daniilidis, Andrew Jaegle

CoRR, 2019

Multimodal Model-Agnostic Meta-Learning via Task-Aware Modulation.

Risto Vuorio, Shao-Hua Sun, Hexiang Hu, Joseph J. Lim

Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019

Composing Complex Skills by Learning Transition Policies.

Youngwoon Lee, Shao-Hua Sun, Sriram Somasundaram, Edward S. Hu, Joseph J. Lim

Proceedings of the 7th International Conference on Learning Representations, 2019

To Follow or not to Follow: Selective Imitation Learning from Observations.

Youngwoon Lee, Edward S. Hu, Zhengyu Yang, Joseph J. Lim

Proceedings of the 3rd Annual Conference on Robot Learning, 2019

2018

3D Interpreter Networks for Viewer-Centered Wireframe Modeling.

Jiajun Wu, Tianfan Xue, Joseph J. Lim, Yuandong Tian, Joshua B. Tenenbaum, Antonio Torralba, William T. Freeman

Int. J. Comput. Vis., 2018

Toward Multimodal Model-Agnostic Meta-Learning.

Risto Vuorio, Shao-Hua Sun, Hexiang Hu, Joseph J. Lim

CoRR, 2018

Zero-Shot Skill Composition and Simulation-to-Real Transfer by Learning Task Representations.

Zhanpeng He, Ryan Julian, Eric Heiden, Hejia Zhang, Stefan Schaal, Joseph J. Lim, Gaurav S. Sukhatme, Karol Hausman

CoRR, 2018

Auto-conditioned Recurrent Mixture Density Networks for Complex Trajectory Generation.

Hejia Zhang, Eric Heiden, Ryan Julian, Zhangpeng He, Joseph J. Lim, Gaurav S. Sukhatme

CoRR, 2018

Scaling Simulation-to-Real Transfer by Learning Composable Robot Skills.

Ryan Julian, Eric Heiden, Zhanpeng He, Hejia Zhang, Stefan Schaal, Joseph J. Lim, Gaurav S. Sukhatme, Karol Hausman

Proceedings of the 2018 International Symposium on Experimental Robotics, 2018

Neural Program Synthesis from Diverse Demonstration Videos.

Shao-Hua Sun, Hyeonwoo Noh, Sriram Somasundaram, Joseph J. Lim

Proceedings of the 35th International Conference on Machine Learning, 2018

Universal Agent for Disentangling Environments and Tasks.

Jiayuan Mao, Honghua Dong, Joseph J. Lim

Proceedings of the 6th International Conference on Learning Representations, 2018

Multi-view to Novel View: Synthesizing Novel Views With Self-learned Confidence.

Shao-Hua Sun, Minyoung Huh, Yuan-Hong Liao, Ning Zhang, Joseph J. Lim

Proceedings of the Computer Vision - ECCV 2018, 2018

Learning and Using the Arrow of Time.

Donglai Wei, Joseph J. Lim, Andrew Zisserman, William T. Freeman

Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition, 2018

Demo2Vec: Reasoning Object Affordances From Online Videos.

Kuan Fang, Te-Lin Wu, Daniel Yang, Silvio Savarese, Joseph J. Lim

Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition, 2018

2017

Multi-Modal Imitation Learning from Unstructured Demonstrations using Generative Adversarial Nets.

Karol Hausman, Yevgen Chebotar, Stefan Schaal, Gaurav S. Sukhatme, Joseph J. Lim

Proceedings of the Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, 2017

Target-driven visual navigation in indoor scenes using deep reinforcement learning.

Yuke Zhu, Roozbeh Mottaghi, Eric Kolve, Joseph J. Lim, Abhinav Gupta, Li Fei-Fei, Ali Farhadi

Proceedings of the 2017 IEEE International Conference on Robotics and Automation, 2017

Knowledge Acquisition for Visual Question Answering via Iterative Querying.

Yuke Zhu, Joseph J. Lim, Li Fei-Fei

Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition, 2017

Unsupervised Visual-Linguistic Reference Resolution in Instructional Videos.

De-An Huang, Joseph J. Lim, Li Fei-Fei, Juan Carlos Niebles

Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition, 2017

2016

High-fidelity facial and speech animation for VR HMDs.

Kyle Olszewski, Joseph J. Lim, Shunsuke Saito, Hao Li

ACM Trans. Graph., 2016

Single Image 3D Interpreter Network.

Jiajun Wu, Tianfan Xue, Joseph J. Lim, Yuandong Tian, Joshua B. Tenenbaum, Antonio Torralba, William T. Freeman

Proceedings of the Computer Vision - ECCV 2016, 2016

Physics 101: Learning Physical Object Properties from Unlabeled Videos.

Jiajun Wu, Joseph J. Lim, Hongyi Zhang, Joshua B. Tenenbaum, William T. Freeman

Proceedings of the British Machine Vision Conference 2016, 2016

2015

Toward visual understanding of everyday object.

Joseph J. Lim

PhD thesis, 2015

Galileo: Perceiving Physical Object Properties by Integrating a Physics Engine with Deep Learning.

Jiajun Wu, Ilker Yildirim, Joseph J. Lim, Bill Freeman, Joshua B. Tenenbaum

Proceedings of the Advances in Neural Information Processing Systems 28: Annual Conference on Neural Information Processing Systems 2015, 2015

Discovering states and transformations in image collections.

Phillip Isola, Joseph J. Lim, Edward H. Adelson

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2015

2014

FPM: Fine Pose Parts-Based Model with 3D CAD Models.

Joseph J. Lim, Aditya Khosla, Antonio Torralba

Proceedings of the Computer Vision - ECCV 2014, 2014

Looking Beyond the Visible Scene.

Aditya Khosla, Byoungkwon An, Joseph J. Lim, Antonio Torralba

Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, 2014

2013

Parsing IKEA Objects: Fine Pose Estimation.

Joseph J. Lim, Hamed Pirsiavash, Antonio Torralba

Proceedings of the IEEE International Conference on Computer Vision, 2013

Sketch Tokens: A Learned Mid-level Representation for Contour and Object Detection.

Joseph J. Lim, C. Lawrence Zitnick, Piotr Dollár

Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition, 2013

2011

Transfer Learning by Borrowing Examples for Multiclass Object Detection.

Joseph J. Lim, Ruslan Salakhutdinov, Antonio Torralba

Proceedings of the Advances in Neural Information Processing Systems 24: 25th Annual Conference on Neural Information Processing Systems 2011. Proceedings of a meeting held 12-14 December 2011, 2011

2010

Exploiting hierarchical context on a large database of object categories.

Myung Jin Choi, Joseph J. Lim, Antonio Torralba, Alan S. Willsky

Proceedings of the Twenty-Third IEEE Conference on Computer Vision and Pattern Recognition, 2010

2009

Context by region ancestry.

Joseph J. Lim, Pablo Arbeláez, Chunhui Gu, Jitendra Malik

Proceedings of the IEEE 12th International Conference on Computer Vision, ICCV 2009, Kyoto, Japan, September 27, 2009

Recognition using regions.

Chunhui Gu, Joseph J. Lim, Pablo Arbeláez, Jitendra Malik

Proceedings of the 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2009), 2009

2007

A Distributed Message Passing Algorithm for Sensor Localization.

Max Welling, Joseph J. Lim

Proceedings of the Artificial Neural Networks, 2007