Learning to Control DC Motor for Micromobility in Real Time with Reinforcement Learning
IEEE International Conference on Intelligent Transportation Systems (ITSC), 2022
Bibek Poudel*, Thomas Watson*, and Weizi Li
*equal contribution
University of Memphis
Abstract
Autonomous micromobility has been attracting the attention of researchers and practitioners in recent years. A key component of many micro-transport vehicles is the DC motor, a complex dynamical system that is continuous and non-linear. Learning to quickly control the DC motor in the presence of disturbances and uncertainties is desired for various applications that require robustness and stability. Techniques to accomplish this task usually rely on a mathematical system model, which is often insufficient to anticipate the effects of time-varying and interrelated sources of non-linearities. While some model-free approaches have been successful at the task, they rely on massive interactions with the system and are trained in specialized hardware in order to fit a highly parameterized controller. In this work, we learn to steer a DC motor via sample-efficient reinforcement learning. Using data collected from hardware interactions in the real world, we additionally build a simulator to experiment with a wide range of parameters and learning strategies. With the best parameters found, we learn an effective control policy in one minute and 53 seconds on a simulation and in 10 minutes and 35 seconds on a physical system.
Links
Presentation
Citation
@InProceedings{Poudel2022NFQ,
author = {Bibek Poudel, Thomas Watson, and Weizi Li},
title = {Learning to Control DC Motor for Micromobility in Real Time with Reinforcement Learning},
booktitle = {IEEE International Conference on Intelligent Transportation Systems (ITSC)},
year = {2022}
}
Contact
Bibek Poudel (bpoudel@memphis.edu) and Weizi Li (wli@memphis.edu)
Acknowledgements
This research is partially funded by NSF IIS 2153426. The authors would also like to thank NVIDIA and the University of Memphis for their support.