Reinforcement Learning-based Sim-to-Real Impedance Parameter Tuning for Robotic Assembly

When performing robotic assembly, a task should be conducted through force-based control such as impedance control. Using impedance control, it is possible to control the contact force by appropriately adjusting the impedance parameters. However, the impedance parameters should be set by the user because it is difficult to accurately recognize the dynamics of the contact environment, which takes a lot of time because it should be performed whenever the assembly task changes. Moreover, the parameters may not be optimal because it depends on the experience and skill level of the user. To this end, a reinforcement learning-based impedance parameter tuning method is proposed in this study. Since this method uses only the physics-based robotic simulation on the virtual environment, there is no risk of damaging the robots or parts and learning time can be significantly reduced. The proposed method was verified by assembling an HDMI connector with a tolerance of 0.03 mm. Impedance parameters were learned in the virtual environment and transferred to the real environment. Finally, it was confirmed that parameter tuning for impedance without the aid of the user is possible by using the proposed method.