Table of Contents

Reading group

We want to cover interesting papers with a focus on those recently published. Everyone is expected to read the papers on their own, so that the meeting can focus on discussion of the paper's merits, issues, and possible extensions.

While we'll have a nominal queue of papers to follow, we should be open to changing what we read and discuss the following week, based on our discussion of the current paper.

Each week one member of the reading group will be designated as the moderator. Your job should not be to present the entire paper to the group, but instead to encourage participation by summarizing important parts of the paper and having probing questions ready to excite discussion.

We would like to pick our papers from recent robotics and machine learning conferences such as RSS, ICRA, IROS, ICML, NeurIPS, and Humanoids. Journal articles from IJRR, TRO, Autonomous Robots, JMLR, ML, and PAMI are also a good place to look. We have a more complete list of publication venues if you are interested.

We meet in LCR (MEB), at 4:00-5:00PM on Thursdays (Fall 2024).

We manage meetings through slack workspace Kahlert School of Computing, channel: '#robotics-reading-group'


General Discussion Guidelines & Questions

Starting Spring 2021 we have added the following guidelines:

List of general questions to consider in reading / leading the group:


Fall 2024

Date Paper Presenters
08/22/2024 Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robots;Cheng Chi, Zhenjia Xu, Chuer Pan, Eric Cousineau, Benjamin Burchfiel, Siyuan Feng, Russ Tedrake, Shuran Song Martin
08/29/2024 Resolution-Optimal Motion Planning for Steerable Needles;Mengyu Fu; Kiril Solovey; Oren Salzman; Ron Alterovitz Emma
09/05/2024 "No, to the Right" -- Online Language Corrections for Robotic Manipulation via Shared Autonomy;Yuchen Cui, Siddharth Karamcheti, Raj Palleti, Nidhya Shivakumar, Percy Liang, Dorsa Sadigh Zohre
09/12/2024 ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulation;Wenlong Huang, Chen Wang, Yunzhu Li, Ruohan Zhang, Li Fei-Fei Yixuan
09/19/2024 JIGGLE: An Active Sensing Framework for Boundary Parameters Estimation in Deformable Surgical Environments; Nikhil Uday Shinde, Xiao Liang, Fei Liu, Yutong Zhang, Florian Richter, Sylvia Herbert, Michael C. Yip Shing Hei
09/26/2024 Conformalized Teleoperation: Confidently Mapping Human Inputs to High-Dimensional Robot Actions; Michelle D Zhao, Reid Simmons, Henny Admoni, Andrea Bajcsy Jordan
10/03/2024 Full-Order Sampling-Based MPC for Torque-Level Locomotion Control via Diffusion-Style Annealing; Haoru Xue, Chaoyi Pan, Zeji Yi, Guannan Qu, and Guanya Shi Mohan
10/10/2024 Fall Break: No Meeting
10/17/2024 Dr. Madan Musuvathi's talk: No Meeting
10/24/2024 Stretchable e-skin and transformer enable high-resolution morphological reconstruction for soft robots; Delin Hu, Francesco Giorgio-Serchi, Shiming Zhang & Yunjie Yang Daniel
10/31/2024 Yell At Your Robot: Improving On-the-Fly from Language Corrections; Lucy Xiaoyang Shi, Zheyuan Hu, Tony Z. Zhao, Archit Sharma, Karl Pertsch, Jianlan Luo, Sergey Levine, Chelsea Finn Connor
11/07/2024 RT-Sketch: Goal-Conditioned Imitation Learning from Hand-Drawn Sketches; Priya Sundaresan, Quan Vuong, Jiayuan Gu, Peng Xu, Ted Xiao, Sean Kirmani, Tianhe Yu, Michael Stark, Ajinkya Jain, Karol Hausman, Dorsa Sadigh, Jeannette Bohg, Stefan Schaal Siyeon
11/14/2024 GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language Models; Mirzadeh, Keivan Alizadeh, Hooman Shahrokhi, Oncel Tuzel, Samy Bengio, Mehrdad Farajtabar Joe
11/21/2024 MotionLM: Multi-Agent Motion Forecasting as Language Modeling; Ari Seff, Brian Cera, Dian Chen, Mason Ng, Aurick Zhou, Nigamaa Nayakanti, Khaled S. Refaat, Rami Al-Rfou, Benjamin Sapp (ICCV 2023) Siyeon
11/28/2024 Thanksgiving Break: No Meeting
12/05/2024
12/12/2024

Past Papers

Date Paper Presenters
09/24/2015 PILCO: "Gaussian Processes for Data-Efficient Learning in Robotics and Control" PAMI, 2015.
Recent application: "Learning Legged Swimming Gaits from Experience", ICRA, 2015.
10/01/2015 "Probabilistic Differential Dynamic Programming", NeurIPS 2014.
10/08/2015 "A generalized iterative LQG method for locally-optimal feedback control of constrained nonlinear stochastic systems"; Emanuel Todorov and Weiwei Li; ACC 2005. - ILQG
"Adaptive Optimal Feedback Control with Learned Internal Dynamics Models"; Djordje Mitrovic, Stefan Klanke, and Sethu Vijayakumar; From Motor Learning to Interactive Learning in Robotics 2010
GP dynamics with iLQG
Embed to Control: A Locally Linear Latent Dynamics Model for Control from Raw Images
10/22/2015 Guided Policy Search (GPS)
Learning Complex Neural Network Policies with Trajectory Optimization
Variational Policy Search via Trajectory Optimization
10/29/2015 GPS with Unknown Dynamics
ICRA Paper
http://www.eecs.berkeley.edu/~svlevine/papers/mfcgps.pdf
http://rll.berkeley.edu/icra2015gps/index.htm
End-to-End Training of Deep Visuomotor Policies
Video
11/12/2015 DMPs
POWER for Robots
Policy Search in Robotics Survey
11/19/2015 PoWER and Policy Gradients
PoWER
Survey on RL in Robotics
12/03/2015 REPS
01/29/2016 Sequential REPS
02/05/2016 ProMPs
ProMPs
ProMPs on Robots
02/12/2016 Model-Free Probabilistic Movement Primitives for Physical Interaction, Paraschos, A.; Rueckert, E.; Peters, J; Neumann, G. IROS 2015
02/19/2016 "DATA AS DEMONSTRATOR with Applications to System Identification" Arun Venkatraman, Byron Boots, Martial Hebert, and J. Andrew Bagnell; NeurIPS Workshop on Autonomously Learning Robots 2014
02/26/2016 "A survey of reinforcement learning in Robotics"
03/04/2016 Continue with: "A survey of reinforcement learning in Robotics"
03/11/2016 "Incremental, Sensor-Based Motion Generation for Mobile Manipulators in Unknown, Dynamic Environments", Peter Lehner, Arne Sieverling, Oliver Brock, ICRA, 2015.
03/18/2016 "LQR-trees: Feedback Motion Planning via Sums-of-Squares Verification", Tedrake et al., IJRR 2014.
03/25/2016 "Generating Multi-Fingered Robotic Grasps via Deep Learning", Jacob Varley, Jonathan Weisz, Jared Weiss, Peter Allen, IROS 2015.
04/01/2016"Supersizing Self-supervision: Learning to Grasp from 50K Tries and 700 Robot Hours", Lerrel Pinto and Abhinav Gupta, ICRA 2016.
04/08/2016 "Learning Hand-Eye Coordination for Robotic Grasping with Deep Learning and Large-Scale Data Collection", Sergey Levine, Peter Pastor, Alex Krizhevsky, Deirdre Quillen.
Blog Post
04/22/2016 Planning Grasp Strategies That Exploit Environmental Constraints,Clemens Eppner and Oliver Brock, ICRA 2015.
04/29/2016 "Integrated Task and Motion Planning in Belief Space,Leslie Pack Kaelbling, Tomas Lozano-Perez, International Journal of Robotics Research, 2013
05/06/2016 QLAP - Autonomous Learning of High-Level States and Actions in Continuous Environments, Jonathan Mugan and Benjamin Kuipers
05/13/2016 "Feedback Controller Parameterizations for Reinforcement Learning", IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL), 2011
05/20/2016 "Methods for Collision-Free Arm Teleoperation in Clutter Using Constraints from 3D Sensor Data", Adam Leeper, Kaijen Hsiao, Matei Ciocarlie, Ioan Sucan, and Kenneth Salisbury, Humanoids 2013.
05/27/2016 "Tactile manipulation with biomimetic active touch";Luke Cramphorn, Benjamin Ward-Cherrier, and Nathan F. Lepora; ICRA 2016.
06/03/2016 "Robot Grasping in Clutter:Using a Hierarchy of Supervisors for Learning from Demonstrations";Michael Laskey, Jonathan Lee, Caleb Chuck, David Gealy, Wesley Hsieh, Florian T. Pokorny, Anca D. Dragan, and Ken Goldberg; CASE 2016.
06/10/2016 Data-Driven Online Decision Making for Autonomous Manipulation", Daniel Kappler, Peter Pastor, Mrinal Kalakrishnan, Manuel Wuthrich, Stefan Schaal, RSS 2015.
06/17/2016 "Deep Learning for Tactile Understanding From Visual and Haptic Data",Yang Gao, Lisa Anne Hendricks, Katherine J. Kuchenbecker,and Trevor Darrell, ICRA 2016.
06/24/2016 "Kinematically Constrained Workspace Control via Linear Optimization"; Zachary K. Kingston, Neil T. Dantam, and Lydia E. Kavraki; Humanoids 2015.
code
07/01/2016 "Learning Relevant Features for Manipulation Skills using Meta-level Priors", Oliver Kroemer, Gaurav S. Sukhatme.
07/08/2016 "Efficient Grounding of Abstract Spatial Concepts for Natural Language Interaction with Robot Manipulators"
07/15/2016 "Approximate Inference Optimal Control"; Marc Toussaint; ICML 2009.
07/22/2016 "Motion Planning as Probabilistic Inference using Gaussian Processes and Factor Graphs"; Jing Dong, Mustafa Mukadam, Frank Dellaert, Byron Boots; RSS 2016.
07/29/2016 "Optimal Control with Learned Local Models: Application to Dexterous Manipulation"; Vikash Kumar, Emanuel Todorov, and Sergey Levine; ICRA 2016.
08/05/2016 "A factor graph approach to estimation and model predictive control on Unmanned Aerial Vehicles"; Duy-Nguyen Ta, Marin Kobilarov, and Frank Dellaert, ICUAS, 2014.
08/12/2016 "Automatic LQR Tuning Based on Gaussian Process Optimization: Early Experimental Results"; Alonso Marco, Philipp Hennig, Jeannette Bohg, Stefan Schaal,and Sebastian Trimpe; ICRA 2016.
08/19/2016 "Robust Trajectory Optimization Under Frictional Contact with Iterative Learning" Jingru Luo and Kris Hauser, RSS 2015.
09/15/2016 Manipulation with Fluids; ppt
09/22/2016 Legged locomotion control
09/29/2016 "Coordinated multi-arm motion planning: Reaching for moving objects in the face of uncertainty"; RSS 2016.
10/20/2016 Gaze prediction using machine learning for dynamic stereo manipulation in games
11/03/2016 Assembly Sequence Planning for Constructing Planar Structures with Rectangular Modules
11/17/2016 Human-level control through deep reinforcement learning
12/01/2016 Deep Recurrent Q-Learning for Partially Observable MDPs
01/23/2017 "A reservoir computing approach for learning forward dynamics of industrial manipulators"; Athanasios S. Polydoros and Lazaros Nalpantidis; IROS 2016.
01/30/2017 "Extended and Unscented Kitchen Sinks"; Edwin V. Bonilla, Daniel Steinberg, and Alistair Reid; ICML 2016.
02/06/2017 "Verification and Synthesis of Admissible Heuristics for Kinodynamic Motion Planning"; Brian Paden, Valerio Varricchio, and Emilio Frazzoli; IEEE Robotics and Automation Letters 2017.
02/21/2017 "Value Iteration Networks"; Aviv Tamar, Yi Wu, Garrett Thomas, Sergey Levine, and Pieter Abbeel; NeurIPS 2016.
03/07/2017 "From Object Categories to Grasp Transfer Using Probabilistic Reasoning"; Marianna Madry, Dan Song and Danica Kragic; ICRA 2012.
03/14/2017 "Tell Me Dave: Context-Sensitive Grounding of Natural Language to Manipulation Instructions"; Dipendra K Misra, Jaeyong Sung, Kevin Lee and Ashutosh Saxena; IJRR 2016.
03/21/2017 "Trajectory learning from human demonstrations via manifold mapping"; Hiratsuka, Michihisa, Ndivhuwo Makondo, Benjamin Rosman, and Osamu Hasegawa; IROS 2016.
04/04/2017 "Edward: A library for probabilistic modeling, inference, and criticism"; Dustin Tran, Alp Kucukelbir, Adji B. Dieng, Maja Rudolph, Dawen Liang, and David M. Blei; Archiv 2016.
04/11/2017 "Auto-encoding variational Bayes"; D.P. Kingma, M. Welling; ICLR 2014.
04/18/2017 "Modeling Grasp Motor Imagery through Deep Conditional Generative Models"; Matthew Veres, Medhat Moussa, Graham W. Taylor; IEEE Robotics and Automation Letters 2(2): 757-764, 2017.
04/25/2017 "Generative Adversarial Networks"; Ian J. Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, Yoshua Bengio; Neural Information Processing Systems 2014. "Generative Adversarial Imitation Learning"; Jonathan Ho, Stefano Ermon; Advances in Neural Information Processing Systems 2016.
05/08/2017 "MOSAIC Model for Sensorimotor Learning and Control"; Haruno, Masahiko, Daniel M. Wolpert, and Mitsuo Kawato; Neural Computation 2001.
05/15/2017 "Computationally Efficient Rigid-Body Gaussian Process for Motion Dynamics"; Muriel Lang and Sandra Hirche; IEEE Robotics and Automation Letters July 2017.
05/22/2017 A Comparison of Autoregressive Hidden Markov Models for Multimodal Manipulations With Variable Masses; Kroemer, Oliver and Peters, Jan; IEEE Robotics and Automation Letters 2017.
06/05/2017 "Coding and use of tactile signals from the fingertips in object manipulation tasks"; Nature, 2009.
06/12/2017 "Human-Inspired Robotic Grasp Control with Tactile Sensing"; IEEE Transaction on Robotics, 2011.
06/19/2017 "One-Shot Learning of Manipulation Skills with Online Dynamics Adaptation and Neural Network Priors"; IROS, 2016 .
06/26/2017 "Information Theoretic MPC for Model-Based Reinforcement Learning"; Grady Williams, Nolan Wagener, Brian Goldfain, Paul Drews, James M. Rehg, Byron Boots, and Evangelos A. Theodorou; ICRA, 2017.
07/03/2017 No meeting for observing Independance day
07/10/2017 "Gaussian process implicit surfaces for shape estimation and grasping"; Stanimir Dragiev, Marc Toussaint, and Michael Gienger; ICRA, 2011.
07/31/2017 "Simultaneous Trajectory Estimation and Planning via Probabilistic Inference"; Mustafa Mukadam, Jing Dong, Frank Dellaert, and Byron Boots; RSS 2017
08/07/2017 "A Probabilistic Planning Framework for Planar Grasping Under Uncertainty"
08/14/2017 "A kernel-based approach to learning contact distributions for robot manipulation tasks"; Oliver Kroemer, Simon Leischnig, Stefan Luettgen, Jan Peters; Autonomous Robots, 2017.
08/24/2017 "Probabilistic Data Association for Semantic SLAM"; Sean L. Bowman, Nikolay Atanasov, Kostas Daniilidis, George J. Pappas; ICRA, 2017.
08/31/2017 “Model-Predictive Motion Planning”, Thomas Howard, Mihail Pivtoraiko, Ross A. Knepper, and Alonzo Kelly.IEEE Robotics and Automation Magazine, 21(1):64-73, March 2014.
09/07/2017 "Using Geometry to Detect Grasps in 3D Point Clouds", Andreas ten Pas, Robert Platt. agile grasp code
09/21/2017 "Planning How to Learn" Haoyu Bai David Hsu Wee Sun Lee; ICRA 2013.
09/28/2017 "Combined Optimization and Reinforcement Learning for Manipulation Skills", Peter Englert, Marc Toussaint, RSS 2016.
10/05/2017 "The Intentional Unintentional Agent:Learning to Solve Many Continuous Control Tasks Simultaneously", Cabi et al. (DeepMind), CoRL 2017.
10/19/2017 "An Analysis of Monte Carlo Tree Search"; S. James, G.D. Konidaris, and B. Rosman; AAAI 2017.
10/26/2017 "Learning in POMDPs with Monte Carlo Tree Search", Katt, Sammie and Oliehoek, Frans A and Amato, Christopher, ICML 2017.
11/2/2017 "The Infinite Regionalized Policy Representation", Liu, Miao and Liao, Xuejun and Carin, Lawrence, ICML 2011
11/9/2017 "Efficient planning in non-Gaussian belief spaces and its application to robot grasping" Platt, Robert and Kaelbling, Leslie and Lozano-Perez, Tomas and Tedrake, Russ, ISRR 2011
11/16/2017 "Bayesian Eigenobjects: A Unified Framework for 3D Robot Perception" Benjamin Burchfiel and George Konidaris, RSS 2017
11/30/2017 "Goal Set Inverse Optimal Control and Iterative Re-planning for Predicting Human Reaching Motions in Shared Workspaces" Jim Mainprice, Rafi Hayne and Dmitry Berenson, IEEE Transaction on Robotics (TRO), 2016
12/07/2017 "Planning and control for dynamic, nonprehensile, and hybrid manipulation tasks" J. Zachary Woodruff, Kevin M. Lynch, ICRA 2017 - IEEE International Conference on Robotics and Automation, 2017
01/10/2018 Writing exercise for all participants; bring pen and paper; no reading
01/17/2018 "The optimal control of partially observable Markov processes over the infinite horizon: Discounted costs", Sondik, Edward J, Operations research 1978
01/24/2018 "Motion planning under uncertainty using iterative local optimization in belief space", Van Den Berg, Jur and Patil, Sachin and Alterovitz, Ron, The International Journal of Robotics Research (IJRR); 2012.
01/31/2018 "Integrated Perception and Planning in the Continuous Space: A POMDP Approach", Haoyu Bai, David Hsu, Wee Sun Lee; RSS 2013
02/07/2018 "Belief space planning simplified: Trajectory-optimized lqg (t-lqg)", Rafieisakhaei, Mohammadhussein and Chakravorty, Suman and Kumar, PR, arXiv preprint 2016
02/14/2018 "Dual Execution of Optimized Contact Interaction Trajectories", Marc Toussaint, Nathan Ratliff, Jeannette Bohg, Ludovic Righetti, Peter Englert, Stefan Schaal; IROS 2014
02/21/2018 "A Probabilistic Particle-Control Approximation of Chance-Constrained Stochastic Predictive Control", Lars Blackmore, Masahiro Ono, Askar Bektassov, and Brian C. Williams; TRO 2010.
02/28/2018 "Pose estimation for planar contact manipulation with manifold particle filters", Koval, Michael C and Pollard, Nancy S and Srinivasa, Siddhartha S, The International Journal of Robotics Research (IJRR) 2015
03/14/2018 "Pre-and post-contact policy decomposition for planar contact manipulation under uncertainty", Koval, Michael C and Pollard, Nancy S and Srinivasa, Siddhartha S, Robotics: Science and Systems 2014
03/21/2018 "Randomized Physics-based Motion Planning for Grasping in Cluttered and Uncertain Environments"; Muhayyuddin, Mark Moll, Lydia Kavraki, Jan Rosell; RA-L 2017.
03/28/2018 "Extending the Applicability of POMDP Solutions to Robotic Tasks"; Devin K. Grady, Mark Moll, Lydia E. Kavraki; IEEE Transactions on Robotics , 2015.
04/04/2018 "Learning Robot Objectives from Physical Human Interaction", Bajcsy, Andrea and Losey, Dylan P and O’Malley, Marcia K and Dragan, Anca D; Conference on Robot Learning ;2017.
04/11/2018 "Robust trajectory selection for rearrangement planning as a multi-armed bandit problem", Koval, Michael C and King, Jennifer E and Pollard, Nancy S and Srinivasa, Siddhartha S, Intelligent Robots and Systems (IROS) 2015
04/18/2018 "Model-based Bayesian reinforcement learning in partially observable domains", Poupart, Pascal and Vlassis, Nikos, Proc Int. Symp. on Artificial Intelligence and Mathematics 2008
04/25/2018 An Online and Approximate Solver for POMDPs with Continuous Action Space; K. Seiler and H. Kurniawati and S.P.N. Singh. ; Proc. IEEE Int. Conference on Robotics and Automation (ICRA). 2015. (Best Conference Paper Award Finalist)
05/02/2018 Deep Visual Foresight for Planning Robot Motion; Chelsea Finn and Sergey Levine; ICRA 2017.
05/09/2018 "POND-Hindsight: Applying Hindsight Optimization to POMDPs", Alan Olsen, Daniel Bryce, and "Shared autonomy via hindsight optimization", Javdani, Shervin and Srinivasa, Siddhartha S and Bagnell, J Andrew, arXiv preprint 2017
05/16/2018 Maximum Entropy Inverse Reinforcement Learning, Brian D. Ziebart, Andrew Maas, J.Andrew Bagnell, and Anind K. Dey, AAAI 2008
05/23/2018 Modeling Interaction via the Principle of Maximum Causal Entropy, Ziebart 2010
05/30/2018 Inverse Reinforcement Learning with PI^2 (short support paper) and Learning Objective Functions for Manipulation, Kalakrishnan, M., Pastor, P., Righetti, L. and Schaal, S., ICRA 2013
06/06/2018 Maximum Entropy Deep Inverse Reinforcement Learning, Wulfmeier, M., Ondruska, P. and Posner, I., arXiv preprint 2015
06/13/2018 Relative Entropy Inverse Reinforcement Learning, Boularias, A., Kober, J. and Peters, J., ICAIS 2011
06/20/2018 Compatible Reward Inverse Reinforcement Learning , Metelli, Alberto Maria, Matteo Pirotta, and Marcello Restelli, NeurIPS 2017
06/27/2018 Inverse Reinforcement Learning via Nonparametric Spatio-Temporal Subgoal Modeling, Šošić, A., Rueckert, E., Peters, J., Zoubir, A. M., & Koeppl, H., arXiv preprint 2018
08/29/2018 “Chimpanzee Intelligence in Nature and in Captivity: Isomorphism of Symbol Use and Tool Use”; Tetsuro Matsuzawa; Great Ape Societies, Chapter 15, 1996.
09/05/2018 "Differentiable Physics and Stable Modes for Tool-Use and Manipulation Planning"; Marc Toussaint, Kelsey Allen, Kevin Smith, Joshua Tenenbaum; RSS 2018.
09/19/2018 A Survey of the Ontogeny of Tool Use: From Sensorimotor Experience to Planning; Frank Guerin, Norbert Krüger, and Dirk Kraft; IEEE TRANSACTIONS ON AUTONOMOUS MENTAL DEVELOPMENT 2013.
09/26/2018 Guided Search for Task and Motion Plans Using Learned Heuristics,Rohan Chitnis, Dylan Hadfield-Menell, Abhishek Gupta, Siddharth Srivastava, Edward Groshev, Christopher Lin, and Pieter Abbeel, ICRA 2016.
10/03/2018 Towards Emergence of Tool Use in Robots: Automatic Tool Recognition and Use without Prior Tool Learning ; Keng Peng Tee ; Jun Li ; Lawrence Tai Pang Chen ; Kong Wah Wan ; Gowrishankar Ganesh; ICRA 2018.
10/17/2018 Autonomous Environment Manipulation to Assist Humanoid Locomotion ; Martin Levihn; Koichi Nishiwaki; Satoshi Kagami; Mike Stilman; ICRA 2014.
10/24/2018 Simulation as an Engine of Physical Scene Understanding ; Peter W. Battaglia, Jessica B. Hamrick, and Joshua B. Tenenbaum; PNAS 2013.
10/31/2018 Understanding Tools: Task-Oriented Object Modeling, Learning and Recognition; Yixin Zhu, Yibiao Zhao, and Song Chun Zhu; CVPR 2015.
11/07/2018 Object–object interaction affordance learning; Yu Sun, Shaogang Ren, Yun Lin; Robotics and Autonomous Systems 2014.
11/14/2018 Learning Task-Oriented Grasping for Tool Manipulation from Simulated Self-Supervision; Kuan Fang, Yuke Zhu, Animesh Garg, et. al.; ArXiv preprint 2018 (for RSS 2019).
11/28/2018 What Can I Do With This Tool? Self-Supervised Learning of Tool Affordances From Their 3-D Geometry; Tanis Mar, Vadim Tikhanof, Lorenzo Natale; IEEE Transactions on Cognitive and Developmental Systems 2018.
12/05/2018 Tool Use Learning in Robots; Solly Brown and Claude Sammut; Advances in Cognitive Systems 2011.
12/12/2018 Manipulating articulated objects with interactive perception; Dov Katz, Oliver Brock
01/09/2019 Ratliff, N., Toussaint, M., & Schaal, S. (2015, May). Understanding the geometry of workspace obstacles in motion optimization. In Robotics and Automation (ICRA), 2015 URL Bala
01/16/2019 C. Roesmann, W. Feiten, T. Woesch, F. Hoffmann and T. Bertram, “Trajectory modification considering dynamic constraints of autonomous robots,” ROBOTIK 2012; 7th German Conference on Robotics, Munich, Germany, 2012 URL Griffin
01/23/2019 C. Cheng, M. Mukadam, J. Issac, S. Birchfield, D. Fox, B. Boots, & N. Ratliff; "RMPflow: A Computational Graph for Automatic Motion Policy Generation"; Workshop on Algorithmic Foundations of Robotics (WaFR); 2018. Tucker
01/30/2019 Daniel Kappler, Franziska Meier, Jan Issac, Jim Mainprice, Cristina Garcia Cifuentes, Manuel Wüthrich, Vincent Berenz, Stefan Schaal, Nathan Ratliff, Jeannette Bohg; "Real-Time Perception Meets Reactive Motion Generation"; IEEE Robotics and Automation: Letters (RA-L), 2018. Adam
02/06/2019 Snow Day Ullr
02/13/2019 Alan Kuntz, Chris Bowen, and Ron Alterovitz, “Fast Anytime Motion Planning in Point Clouds by Interleaving Sampling and Interior Point Optimization”; International Symposium on Robotics Research (ISRR, 2017.) Roya
02/20/2019 Jonathan D. Gammell, Siddhartha S. Srinivasa, Timothy D. Barfoot; "Batch Informed Trees (BIT*)"; IEEE International Conference on Robotics and Automation (ICRA); 2015 Michael Bentley
02/27/2019 Nika Haghtalab, Simon Mackenzie, Ariel D. Procaccia, Oren Salzman, Siddhartha S. Srinivasa; "The Provable Virtue of Laziness in Motion Planning"; International Conference on Automated Planning and Scheduling (ICAPS); 2019 Roya
03/06/2019 Jemin Hwangbo, Joonho Lee, Alexey Dosovitskiy, Dario Bellicoso, Vassilios Tsounis, Vladlen Koltun, Marco Hutter; "Learning agile and dynamic motor skills for legged robots"; 2019; Video Matt
03/13/2019 Spring Break - Lab planning meeting Tucker
03/20/2019 Mayne, David Q and Kerrigan, Erric C and Van Wyk, EJ and Falugi, P; "Tube-based robust nonlinear model predictive control"; International Journal of Robust and Nonlinear Control; 2011 ; Related paper:Sumeet Singh, Marco Pavone and Jean-Jacques E. Slotine; Tube-Based MPC: a Contraction Theory Approach Qingkai
03/27/2019 Path-Following through Control Funnel Functions Braxton
04/03/2019 Chiang, Hao-Tien Lewis and HomChaudhuri, Baisravan and Smith, Lee and Tapia, Lydia; Safety, challenges, and performance of motion planners in dynamic environments; ISRR; 2017 Amir
04/10/2019 Florian Brandherm, Jan Peters, Gerhard Neumann and Riad Akrour; Learning Replanning Policies with Direct Policy Search ; RAL; 2018 Adam
04/17/2019 "Motion Planning Networks" Ahmed H. Qureshi, Anthony Simeonov, Mayur J. Bency and Michael C. Yip; ICRA, 2019. Qingkai
04/24/2019 "Deep Reinforcement Learning in a Handful of Trials using Probabilistic Dynamics Models " Kurtland Chua, Roberto Calandra, Rowan McAllister, Sergey Levine; NeurIPS, 2018. Griffin
05/01/2019 "GuSTO: Guaranteed Sequential Trajectory Optimization via Sequential Convex Programming"; Riccardo Bonalli, Abhishek Cauligi, Andrew Bylard, Marco Pavone; ICRA, 2019 Bala
05/10/2019 Schulman, John and Wolski, Filip and Dhariwal, Prafulla and Radford, Alec and Klimov, Oleg. Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347, 2017 Matt
05/17/2019 Mnih, Volodymyr and Kavukcuoglu, Koray and Silver, David and Graves, Alex and Antonoglou, Ioannis and Wierstra, Daan and Riedmiller, Martin. Playing atari with deep reinforcement learning. arXiv preprint arXiv:1312.5602 Griffin
05/24/2019 Pathak, Deepak and Agrawal, Pulkit and Efros, Alexei A. and Darrell, Trevor. Curiosity-driven Exploration by Self-supervised Prediction. ICML 2017 Mark
05/31/2019 Lillicrap, Timothy P and Hunt, Jonathan J and Pritzel, Alexander and Heess, Nicolas and Erez, Tom and Tassa, Yuval and Silver, David and Wierstra, Daan. Continuous control with deep reinforcement learning (DDPG). ICLR 2016 Mohan
06/07/2019 Ha, David and Schmidhuber, Jurgen. Recurrent World Models Facilitate Policy Evolution. NeurIPS 2018 Qingkai
07/11/2019 Haarnoja, Tuomas and Zhou, Aurick and Abbeel, Pieter and Levine, Sergey. Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor. Arxiv 2018 Griffin
07/18/2019 Finn, Chelsea and Abbeel, Pieter and Levine, Sergey. Model-Agnostic Meta Learning (MAML). ICML 2017 Matt
07/26/2019 Dmitry Kalashnikov, Alex Irpan, Peter Pastor, Julian Ibarz, Alexander Herzog, Eric Jang, Deirdre Quillen, Ethan Holly, Mrinal Kalakrishnan, Vincent Vanhoucke, Sergey Levine. QT-Opt: Scalable Deep Reinforcement Learning for Vision-Based Robotic Manipulation. Arxiv 2018 Qingkai
08/02/2019 Hafner, Danijar, Timothy Lillicrap, Ian Fischer, Ruben Villegas, David Ha, Honglak Lee, and James Davidson Learning Latent Dynamics for Planning from Pixels. Arxiv 2018 Matt
08/16/2019 Ebert, Frederik, Chelsea Finn, Alex X. Lee, and Sergey Levine Self-Supervised Visual Planning with Temporal Skip Connections. CoRL 2017 Griffin
08/21/2019 Oliver Kroemer, Scott Niekum, George Konidaris; "A Review of Robot Learning for Manipulation: Challenges, Representations, and Algorithms" Adam
08/28/2019 Joseph Campbell, Simon Stepputtis, and Heni Ben Amor; "Probabilistic Multimodal Modeling for Human-Robot Interaction Tasks" Bala
09/04/2019 Chris Paxton, Nathan Ratliff, Clemens Eppner, Dieter Fox; "Representing Robot Task Plans as Robust Logical-Dynamical Systems" Roya
09/11/2019 Michael Kaess, Hordur Johannsson, Richard Roberts, Viorela Ila, John Leonard, and Frank Dellaert; iSAM2 Incremental Smoothing and Mapping Using the Bayes Tree Griffin
09/18/2019 Bohan Wu, Iretiayo Akinola, Peter K. Allen; Pixel-Attentive Policy Gradient for Multi-Fingered Grasping in Cluttered Scenes; IROS 2019 Martin
09/25/2019 Tim Pearce, Mohamed Zaki, Alexandra Brintrup, Nicolas Anastassacos, Andy Neely; Uncertainty in Neural Networks: Bayesian Ensembling Michael
10/02/2019 Michael Lutter, Kim Listmann, Jan Peters; Deep Lagrangian Networks for end-to-end learning of energy-based control for under-actuated systems; IROS 2019 And supplemental reading "Deep Lagrangian Networks"; ICRL 2019 Mohan
10/09/2019 Fall Break - No Meeting
10/16/2019 Xie, Christopher and Xiang, Yu and Mousavian, Arsalan and Fox, Dieter; The Best of Both Modes: Separately Leveraging RGB and Depth for Unseen Object Instance Segmentation Qingkai
10/23/2019 Michal Kleinbort, Kiril Solovey, Riccardo Bonalli, Kostas E. Bekris, Dan Halperin; RRT2.0 for Fast and Optimal Kinodynamic Sampling-Based Motion Planning Amir
10/30/2019 Forgetting to Select a Reading Group Paper: A Case Study Griffin
11/06/2019 Mark Van der Merwe, Qingkai Lu, Balakumar Sundaralingam, Martin Matak, Tucker Hermans; Learning Continuous 3D Reconstructions for Geometrically Aware Grasping Mark
11/13/2019 Philipp S. Schmitt, Florian Wirnshofer, Kai M. Wurm, Georg v. Wichert, and Wolfram Burgard; Planning Reactive Manipulation in Dynamic Environments; IROS 2019 Best Paper Amir
11/20/2019 "An Online Learning Approach to Model Predictive Control"; Nolan Wagener, Ching-An Cheng, Jacob Sacks, Byron Boots;RSS 2019. Video; Appendix Tucker
11/27/2019 Thanksgiving Break - No Meeting -
12/04/2019 Yevgen Chebotar, Ankur Handa, Viktor Makoviychuk, Miles Macklin, Jan Issac, Nathan Ratliff, and Dieter Fox; "Closing the Sim-To-Real Loop: Adapting Simulation Randomization with Real World Experience" ICRA 2019 Finalist for Best Student Paper; Video
12/11/2019 Taylor A. Howell, Brian E. Jackson, and Zachary Manchester; "ALTRO: A Fast Solver for Constrained Trajectory Optimization" IROS 2019;
1/14/20 Alex Kendall, Yarin Gal; What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?; NeurIPS 2017
1/21/20 Nathan Ratliff, Franziska Meier, Daniel Kappler, Stefan Schaal; DOOMED: Direct Online Optimization of Modeling Errors in Dynamics
1/28/20 Brad Saund, Sanjiban Choudhury, Siddhartha Srinivasa, and Dmitry Berenson; The Blindfolded Robot: A Bayesian Approach to Planning with Contact Feedback; ISRR 2019; Video
2/4/20 Joschka Boedecker*, Jost Tobias Springenberg*, Jan Wulfing*, Martin Riedmiller; Approximate Real-Time Optimal Control Based onSparse Gaussian Process Models
2/11/20 Active inference: demystified and compared; Noor Sajid, Philip J. Ball, Karl J. Friston; 2019.
2/25/20 Ransalu Senanayake, Fabio Ramos: Bayesian Hilbert Maps for Dynamic Continuous Occupancy Mapping; CoRL 2017
3/3/20 End-to-End Learnable Geometric Vision by Backpropagating PnP Optimization; Chen, Bo and Chin, Tat-Jun and Parra, Alvaro and Cao, Jiewei and Li, Nan; Arxiv 2019.
3/17/20 Jacky Liang, Ankur Handa, Karl Van Wyk, Viktor Makoviychuk, Oliver Kroemer, Dieter Fox; In-Hand Object Pose Tracking via Contact Feedback and GPU-Accelerated Robotic Simulation; ICRA 2020
3/24/20 Rico Jonschkowski, Divyam Rastogi, and Oliver Brock; Differentiable Particle Filters: End-to-End Learning with Algorithmic Priors; RSS 2018
3/31/20 Ma, Xiao, Peter Karkus, David Hsu, and Wee Sun Lee; Particle Filter Recurrent Neural Networks; AAAI 2020.
4/7/20 Mi et al. 2019; Training-Free Uncertainty Estimation for Neural Networks
4/14/20 Pearce et al. 2018; Uncertainty in Neural Networks: Approximately Bayesian Ensembling
07/28/2020 Levine et al. "Learning Agile Robotic Locomotion Skills by Imitating Animals" RSS, 2020 Best paper award
08/03/2020 "3D Deformable Object Manipulation using Deep Neural Networks" IROS, 2019
08/11/2020 "Deep Dynamics Models for Learning Dexterous Manipulation" CoRL, 2019
08/18/2020 "Parts-Based Articulated Object Localization in Clutter Using Belief Propagation" IROS, 2020
09/01/2020 Reachable Sets for Safe, Real-Time Manipulator Trajectory Design, Patrick Holmes et al., RSS 2020
09/15/2020 Robust Guarantees for Perception-Based Control
10/06/2020 Safe Model-Based Meta-Reinforcement Learning: A Sequential Exploration-Exploitation Framework
10/13/2020 Relational Deep Reinforcement Learning
10/20/2020 Self-Attention Based Visual-Tactile Fusion Learning for Predicting Grasp Outcomes
11/03/2020 Turning 30: New Ideas in Inductive Logic Programming
11/10/2020 Lifelong Machine Learning Systems: Beyond Learning Algorithms AAAI Spring Symposium 2013
11/17/2020 Cognitive Neuroscience and the Study of Memory - Milner, Squire, & Kandel; Neuron 1998
11/24/2020 Lifelong Learning and Memory Architecture Discussion
12/01/2020 Neural-Symbolic VQA: Disentangling Reasoning from Vision and Language Understanding NeurIPS 2018
12/08/2020 Relational Learning for Skill Preconditions CoRL 2020
01/19/2021 Planning Meeting Tucker
01/26/2021 A Probabilistic Approach to Mixed Open-loop and Closed-loop Control with Application to Extreme Autonomous Driving; J. Zico Kolter, Christian Plagemann, David T. Jackson, Andrew Y. Ng, Sebastian Thrun; ICRA, 2010. Martin & Adam
02/02/2021 RSS Paper Planning Meeting
02/09/2021 Information Theoretic Model Predictive Q-Learning; Mohak Bhardwaj, Ankur Handa, Dieter Fox, Byron Boots; L4DC, 2020. Griffin & Adam
02/16/2021 Blending MPC & Value Function Approximation for Efficient Reinforcement Learning; Mohak Bhardwaj, Sanjiban Choudhury, Byron Boots; ICLR, 2021. Iain
02/23/2021 Guided Uncertainty-Aware Policy Optimization: Combining Learning and Model-Based Strategies for Sample-Efficient Policy Learning; Michelle A. Lee, Carlos Florensa, Jonathan Tremblay, Nathan Ratliff, Animesh Garg, Fabio Ramos, Dieter Fox; ICRA, 2020. Amir and Mohan
03/02/2021 Residual Policy Learning; Tom Silver, Kelsey Allen, Josh Tenenbaum, Leslie Kaelbling; arxiv; 2018. Amir and Bao
03/09/2021 Soft Spring Break
03/16/2021 Residual Reinforcement Learning for Robot Control; Tobias Johannink*, Shikhar Bahl*, Ashvin Nair*, Jianlan Luo, Avinash Kumar, Matthias Loskyll, Juan Aparicio Ojea, Eugen Solowjow, Sergey Levine; Arxiv; ICRA, 2019. Martin and Griffin
03/23/2021 Data-Efficient Control Policy Search Using Residual Dynamics Learning; Saveriano, Matteo and Yin, Yuchao and Falco, Pietro and Lee, Dongheu; IROS 2017. Griffin and Bao
03/30/2021 ReLMoGen: Leveraging Motion Generation in Reinforcement Learning for Mobile Manipulation; Fei Xia, Chengshu Li, Roberto Martín-Martín, Or Litany, Alexander Toshev, Silvio Savarese; ICRA 2021. Adam and Amir
04/06/2021 A Framework for Efficient Robotic Manipulation; Albert Zhan*, Ruihan Zhao*, Lerrel Pinto, Pieter Abbeel, Misha Laskin; Arxiv, 2020. Mohan and Martin
04/13/2021 Model Predictive Actor-Critic: Accelerating Robot Skill Acquisition with Deep Reinforcement Learning; Andrew S. Morgan, Daljeet Nandha, Georgia Chalvatzaki, Carlo D’Eramo, Aaron M. Dollar, Jan Peters; ICRA 2021. Amir and Tucker
04/20/2021 Sufficiently Accurate Model Learning for Planning; Clark Zhang, Santiago Paternain, Alejandro Ribeiro; Arxiv 2021. Adam and Iain
04/27/2021 Review and discussions of methods
05/04/2021 Critique of proposed new algorithms
09/22/2021 Introduction & General Discussion: "Integrated Task and Motion Planning", Caelan Reed Garrett et al. Annual Review of Control, Robotics, and Autonomous Systems, 2020 Amir, Martin
09/29/2021 "PDDLStream: Integrating Symbolic Planners and Blackbox Samplers via Optimistic Adaptive Planning", Caelan Reed Garrett, Tomas Lozano-P ´ erez, and Leslie Pack Kaelbling, ICAPS 2020 Iain
10/06/2021 "An incremental constraint-based framework for task and motion planning", Neil T. Dantam, Zachary K. Kingston, Swarat Chaudhuri, and Lydia E. Kavraki, IJRR 2018 Martin, Martin
10/13/2021 Continuation of previous meeting Griffin & Martin
10/20/2021 "A Probabilistic Framework for Constrained Manipulations and Task and Motion Planning under Uncertainty", Jung-Su Ha, Danny Driess, Marc Toussaint, ICRA 2020 Adam & Yixuan
10/27/2021 "Representation, learning, and planning algorithms for geometric task and motion planning", Beomjoon Kim et al., IJRR 2021 Bao & Yixuan
11/03/2021 Search-Based Task Planning with Learned Skill Effect Models for Lifelong Robotic Manipulation Jacky Liang, Mohit Sharma, Alex LaGrassa, Shivam Vats, Saumya Saxena, Oliver Kroemer Tucker & Yixuan
11/10/2021 Learning Models as Functionals of Signed-Distance Fields for Manipulation Planning, Danny Driess, Jung-Su Ha, Marc Toussaint, Russ Tedrake, CoRL 2021 video Mohan & Yixuan
11/17/2021 No Meeting
11/24/2021 No Meeting Thanksgiving
12/01/2021 "Learning to Search in Task and Motion Planning with Streams", Mohamed Khodeir et al. Amir
12/08/2021 Deep Visual Reasoning: Learning to Predict Action Sequences for Task and Motion Planning from an Initial Scene Image, Danny Driess, Jung-Su Ha, Marc Toussaint
09/22/2022 "Relational inductive biases, deep learning, and graph networks", Battaglia et al. , 2018 Yixuan & Bao
09/29/2022 "Attention Is All You Need", Vaswani et al., NeurIPS, 2017 Iain & Siyeon
10/6/2022 "Real World Robot Learning with Masked Visual Pre-training", Radosavovic et al., CoRL, 2022 Iain
10/13/2022 No meeting - Fall Break
10/20/2022 "LEARNING MESH-BASED SIMULATION WITH GRAPH NETWORKS", Tobias Pfaff*, Meire Fortunato*, Alvaro Sanchez-Gonzalez*, Peter Battaglia, ICLR, 2021 Martin & Bao
10/27/2022 "SORNet: Spatial Object-Centric Representations for Sequential Manipulation", Wentao Yuan, Chris Paxton, Karthik Desingh, Dieter Fox CoRL 2021 Yixuan
11/03/2022 "GraphDistNet: A Graph-Based Collision-Distance Estimator for Gradient-Based Trajectory Optimization", Yeseung Kim, Jinwoo Kim, and Daehyung Park IROS/RAL 2022 IROS Talk Mohan
11/10/2022 "PACT: Perception-Action Causal Transformer for Autoregressive Robotics Pretraining", Rogerio Bonatti, Sai Vemprala, Shuang Ma, Felipe Frujeri, Shuhang Chen, Ashish Kapoor Tucker & Martin
11/17/2022 "Instruction-Following Agents with Jointly Pre-Trained Vision-Language Models", Hao Liu, Lisa Lee, Kimin Lee, Pieter Abbeel Siyeon & Yixuan
11/24/2022 Gobble! Gobble!
12/01/2022 "Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age", Cesar Cadena, … , John J. Leonard; TRO 2016 Griffin & Tucker
12/08/2022 "Hierarchical Representations and Explicit Memory: Learning Effective Navigation Policies on 3D Scene Graphs using Graph Neural Networks", Zachary Ravichandran et al; ICRA 2022 Martin & Yixuan
12/15/2022 Visual Language Maps for Robot Navigation, Chenguang Huang, Oier Mees, Andy Zeng, Wolfram Burgard; 2022. Martin & Tucker
01/19/2023 "Voxblox Incremental 3D Euclidean Signed Distance Fields for On-Board MAV Planning"; Helen Oleynikova, Zachary Taylor, Marius Fehr, Juan Nieto, and Roland Siegwart; IROS 2017. Iain and Tucker
01/26/2023 "iMAP: Implicit Mapping and Positioning in Real-Time", Edgar Sucar, Shikun Liu, Joseph Ortiz, Andrew J. Davison; ICCV 2021. Martin and Tucker
02/02/2023 "Implicit Geometric Regularization for Learning Shapes" Amos Gropp, Lior Yariv, Niv Haim, Matan Atzmon, and Yaron Lipman, Proceedings of Machine Learning and Systems 2020. Herbie and ?
02/09/2023 "BANMo: Building Animatable 3D Neural Models from Many Casual Videos" Gengshan Yang, Minh Vo, Natalia Neverova, Deva Ramanan, Andrea Vedaldi, Hanbyul Joo, CVPR (Oral) 2022. Bao and Bao
02/16/2023 "NeRF, Representing Scenes as Neural Radiance Fields for View Synthesis " Ben Mildenhall, Pratul P. Srinivasan, Matthew Tancik, Jonathan T. Barron, Ravi Ramamoorthi, Ren Ng, ECCV 2020. Bao and Yixuan
23 Feb 2023 No meeting: Snow Day
03/02/2023 "Learning Multi-Object Dynamics with Compositional Neural Radiance Fields" Danny Driess, Zhiao Huang, Yunzhu Li, Russ Tedrake, Marc Toussaint, CoRL 2022. Yixuan and Martin
03/09/2023 No meeting: Spring Break
03/16/2023 "PaLM-E: An Embodied Multimodal Language Model" Danny Driess, Fei Xia, Mehdi S. M. Sajjadi, Corey Lynch, Aakanksha Chowdhery, Brian Ichter, Ayzaan Wahid, Jonathan Tompson, Quan Vuong, Tianhe Yu, Wenlong Huang, Yevgen Chebotar, Pierre Sermanet, Daniel Duckworth, Sergey Levine, Vincent Vanhoucke, Karol Hausman, Marc Toussaint, Klaus Greff, Andy Zeng, Igor Mordatch, Pete Florence , arXiv Pre Print 2023. Nichols
03/23/2023 "Diffusion Policy: Visuomotor Policy Learning via Action Diffusion" Cheng Chi, Siyuan Feng, Yilun Du, Zhenjia Xu, Eric Cousineau, Benjamin Burchfiel, Shuran Song arxiv 2023 Martin
03/30/2023 "Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardware" Tony Zhao, Vikash Kumar, Sergey Levine, Chelsea Finn arxiv 2023 Martin
04/06/2023 "Panoptic Neural Fields" Kundu, Abhijit and Genova, Kyle and Yin, Xiaoqi and Fathi, Alireza and Pantofaru, Caroline and Guibas, Leonidas and Tagliasacchi, Andrea and Dellaert, Frank and Funkhouser, Thomas CVPR 2022 Tucker
04/13/2023 "Skill-based Meta-Reinforcement Learning" Taewook Nam, Shao-Hua Sun, Karl Pertsch, Sung Ju Hwang, Joseph J Lim ICLR Poster 2022 Iain
04/20/2023 "ARMBench: An Object-centric Benchmark Dataset for Robotic Manipulation" Chaitanya Mitash, Fan Wang, Shiyang Lu, Vikedo Terhuja, Tyler Garaas, Felipe Polido, Manikantan Nambi ICRA 2023 Martin
08/24/2023 "RT-1" and "RT-2"; Google/Deepmind; arxiv. Martin
08/31/2023 Stein Variational Gradient Descent and Dual Online Stein Variational Inference for Control and Dynamics and Stein MPC Griffin
09/7/2023 Global Planning for Contact-Rich Manipulation via Local Smoothing of Quasi-dynamic Contact Models; Tao Pang, H.J. Terry Suh, Lujie Yang, Russ Tedrake; 2022 Tucker
09/14/2023 Cancelled (Martin is British) due to ICRA deadline push
09/21/2023 CLIP-Fields: Weakly Supervised Semantic Fields for Robotic Memory Siyeon
09/28/2023 Predicting Object Interactions with Behavior Primitives: An Application in Stowing Tasks Yixuan
10/05/2023 IROS
10/12/2023 Fall Break
10/19/2023 Canceled (Clash with Organick Lecture)
10/26/2023 STAMP: Differentiable Task and Motion Planning via Stein Variational Gradient Descent Mohan & Yixuan
11/02/2023 Scaling Up and Distilling Down: Language-Guided Robot Skill Acquisition Siyeon & Yixuan
11/09/2023 CoRL
11/16/2023 One-Shot Learning for Task-Oriented Grasping Iain
11/23/2023 Thanksgiving
11/30/2023 Constrained Stein Variational Trajectory Optimization Griffin
18 Jan 2024 "AutoRT: Embodied Foundation Models for Large Scale Orchestration of Robotic Agents"; Google DeepMind; OpenReview (ICLR 2024 under review) Siyeon
25 Jan 2024 "Diffusion Policy: Visuomotor Policy Learning via Action Diffusion"; Cheng Chi, Siyuan Feng, Yilun Du, Zhenjia Xu, Eric Cousineau, Benjamin Burchfiel, Shuran Song arxiv 2023 Zohre, Mohan
01 Feb 2024 "RT-1: Robotics Transformer for Real-World Control at Scale"; Google/Deepmind/Brain; arxiv. Herbie
08 Feb 2024 None None
15 Feb 2024 "SE(3)-DiffusionFields: Learning smooth cost functions for joint grasp and motion optimization through diffusion"; Julen Urain, Niklas Funk, Jan Peters, Georgia Chalvatzaki; ICRA 2023 Mohan
22 Feb 2024 ASAP: Automated Sequence Planning for Complex Robotic Assembly with Physical Feasibility Yunsheng Tian, Karl D.D. Willis, Bassel Al Omari, Jieliang Luo, Pingchuan Ma, Yichen Li, Farhad Javid, Edward Gu, Joshua Jacob, Shinjiro Sueda, Hui Li, Sachin Chitta, Wojciech Matusik; ICRA 2024 Siyeon
29 Feb 2024 Language Embedded Radiance Fields for Zero-Shot Task-Oriented Grasping Rashid, et. al. CoRL 2023 iain
07 Mar 2024 Spring Break
04 Apr 2024 Do As I Can, Not As I Say: Grounding Language in Robotic Affordances; Google; arxiv Mohan

Summer 2020 Optimization Practicum Queue

This reading group is a practicum, meaning we try out what we learn. Our BitBucket sandbox repository is for everyone to share in a common library for implementing and trying out new algorithms and problems.

https://bitbucket.org/robot-learning/ll4ma-opt-sandbox

Date Module Paper Discussion Leader
4/23/20 1 (& 5) Nocedal and Wright Ch 1 & 9; Cross-Entropy Motion Planning Adam and Amir
4/28/20 1 Nocedal and Wright Ch 2 & 3 - Line Search Methods Tucker and Griffin
5/05/20 1 Nocedal and Wright Ch 4 & 5 - Trust Region Methods & Conjugate Gradients Mohan & Martin
5/12/20 1 Nocedal and Wright Ch 6 - Quasi-Newton Methods Martin & Iain
5/19/20 1 Nocedal and Wright Ch 10 & 11 - Gauss Newton and Levenberg Marquardt; Gauss Newton works for motion optimization Tucker & Amir, Mohan, Martin, Roya
5/26/20 2 Nocedal and Wright Ch 12 & Issues All
6/02/20 2 Nocedal and Wright Ch 16 - Quadratic Programming Amir & Mohan
6/09/20 2 Nocedal and Wright Ch 15 & 17 - Penalty & Augmented Lagrangian Methods; Anytime Inequality AugLa Iain & Mike
6/16/20 2 KOMO & ALTRO - Augmented Lagrangian for Trajectory Optimization Griffin & Adam
6/23/20 2 Nocedal and Wright Ch 18 - Sequential Quadratic Programming ; convex feasible set motion planning Roya & Mohan & Amir
6/30/20 2 Nocedal and Wright Ch 14 & 19 - Interior Point Methods Mike & ?
7/07/20 - Break -
7/14/20 - Break -
7/21/20 - Break -
TBA 3 Absil Ch 3 & 4 - Line Search on Manifolds Martin & Tucker
TBA 3 Absil Ch 5 & 6 - Newton's Method on Manifolds Martin & ?
TBA 3 RIEMO - Manifolds and Trajectory Optimization ?
TBA 3 RMPFlow - Manifolds and Online Optimization for Control Adam and Martin
TBA 3 Angles and Rotations ?
TBA 4 Branch and Bound for Integer Programming Mohan & Roya
TBA 4 Branch and Bound for Mixed-Integer Programs Griffin & ?
TBA 4 Mixed Integer Programs for Manipulation Planning ?

Other Possible Optimization Topics