End-to-End Multi-Task Policy Learning from NMPC for Quadruped Locomotion
- Quadruped robots excel in traversing complex, unstructured environments where wheeled robots often fail. However, enabling efficient and adaptable locomotion remains challenging due to the quadrupeds' nonlinear dynamics, high degrees of freedom, and the computational demands of real-time control. Optimization-based controllers, such as Nonlinear Model Predictive Control (NMPC), have shown strong performance, but their reliance on accurate state estimation and high computational overhead makes deployment in real-world settings challenging. In this work, we present a Multi-Task Learning (MTL) framework in which expert NMPC demonstrations are used to train a single neural network to predict actions for multiple locomotion behaviors directly from raw proprioceptive sensor inputs. We evaluate our approach extensively on the quadruped robot Go1, both in simulation and on real hardware, demonstrating that it accurately reproduces expert behavior, allows smooth gait switching, and simplifies the control pipeline for real-time deployment. Our MTL architecture enables learning diverse gaits within a unified policy, achieving high $R^{2}$ scores for predicted joint targets across all tasks.
Document Type: | Preprint |
---|---|
Language: | English |
Author: | Anudeep Sajja, Shahram Khorshidi, Sebastian Houben, Maren Bennewitz |
DOI: | https://doi.org/10.48550/arXiv.2505.08574 |
ArXiv Id: | http://arxiv.org/abs/2505.08574 |
Publisher: | arXiv |
Date of first publication: | 2025/05/13 |
Funding: | This work has been funded by the Federal Ministry of Education and Research of Germany and the state of North-Rhine Westphalia as part of the Lamarr Institute for Machine Learning and Artificial Intelligence, LAMARR22B. |
Departments, institutes and facilities: | Fachbereich Informatik |
Institut für KI und Autonome Systeme (A2S) | |
Dewey Decimal Classification (DDC): | 0 Informatik, Informationswissenschaft, allgemeine Werke / 00 Informatik, Wissen, Systeme / 004 Datenverarbeitung; Informatik |
Entry in this database: | 2025/05/26 |