Robot Era open-sources RL framework Humanoid-Gym to speed up progress on humanoids

The company is a fast-rising pioneer on China's humanoid robot scene. With deep links to the country's prestigious Tsinghua University, it aims to lead the way in the research and development of general-purpose robotics with the potential to solve real-world problems and benefit mankind.


Beijing, China, March 12 -- Robot Era, a fast-rising humanoid robot startup, has announced the decision to open-source its reinforcement learning (RL) framework Humanoid-Gym on GitHub.

The move was intended to lower the threshold to developing RL algorithms for humanoid roboticists worldwide, providing them with a practical platform to build on to avoid "reinventing the wheels."

Robot Era, a Beijing-based company, is one of the first players in the industry worldwide to showcase a humanoid robot's locomotion ability based on end-to-end reinforcement learning.

In videos posted earlier, the company's full-size humanoid robot, XBot-L, standing 1.65 meters tall, can be seen walking on slippery snow and climbing up and down stairs with stability and dexterity, as part of a test on the robot's locomotion capabilities.

Due to the complex structure and control mechanisms, humanoid robots pose a bigger challenge than quadrupedal robotics in the transition from a simulation avatar to a working prototype in the real world.

This process is known as Sim-to-real policy transfer in the parlance of reinforcement learning.

Based on the specific reward functions and domain randomization signals, the Humanoid-Gym framework from Robot Era can appreciably simplify the steps humanoid robots need to take to achieve Sim-to-real translation.

This could significantly streamline the development process, reducing technical difficulty and bolstering engineering productivity.

The framework was previously put to the test on Robot Era's two models, XBot-S and XBot-L, and proved a success.

Another benefit of Humanoid-Gym is that it is calibrated to allow for proof-of-concept tests on humanoid robots in MuJoCo, an advanced simulator for multi-body dynamics, so as to ensure close alignment between a simulated and a real robot model.

The framework also introduced several variables for the assessment of reinforcement learning results, including but not limited to speed tracking and the smoothness of robots.

The open-sourcing of Humanoid-Gym embodies a strong desire on the part of Robot Era to foster knowledge-sharing and innovative exchange in the area of humanoid robotics.

About Robot Era

Founded in August 2023 and incubated by Tsinghua University's Institute for Interdisciplinary Information Sciences, Robot Era is committed to the development of embodied AI and humanoid robotic technologies and products.

Project page:
https://sites.google.com/view/humanoid-gym/
GitHub page:
https://github.com/roboterax/humanoid-gym

Featured Product

The ERT150 - Dorner’s Next Evolution of Edge Roller Technology Conveyors

The ERT150 - Dorner's Next Evolution of Edge Roller Technology Conveyors

The next evolution in Dorner's Edge Roller Technology conveyor platform, the ERT®150, is ideal for small and light-load assembly automation, as well as medical and medical-device assembly application. The ERT platform is the only pallet conveyor of its kind available with an ISO Standard Class 4 rating for cleanroom applications. Earning the ISO Standard 14644-1 Class 4 rating means Dorner's ERT150 will conform and not contribute to the contamination of cleanrooms to those standards. As implied by its name, the ERT150 (Edge Roller Technology) uses rollers to move pallets through the conveyor smoothly with no friction (a byproduct often seen in belt-driven platforms). The conveyor's open design eliminates concerns of small parts or screws dropping into rollers and causing conveyor damage or jamming. The ERT150 is suited to operate in cleanroom environments requiring a pallet handling conveyor. It is capable of zoning for no or low-back pressure accumulation and is ideal for automation assembly applications within industries including medical devices, electronics, consumer goods among others.