Kindred Introduces SenseActTM, the First Reinforcement Learning Open-Source Toolkit for Physical Robots

AI and robotics company launches benchmark task suite for developing and evaluating reinforcement learning methods on robotic hardware.

Kindred, an AI and robotics company that builds intelligence for robots, has announced today the launch of SenseAct, the first open-source toolkit to set-up reinforcement learning tasks on physical robots. Kindreds SenseAct was created to provide robotics developers and researchers with a consistent, learnable interface that efficiently controls for time delays, a factor that simulation environments arent hindered by.


"SenseAct is an important new step in machine learning research on robots, enabling consistent and reproducible results on physical robots for the first time. It will establish a standard that may greatly accelerate machine learning research on physical robots, pushing reinforcement learning to a new level of performance just as large standard data sets have for supervised learning," said Richard S. Sutton, professor of Computing Science and AITF Chair in Reinforcement Learning and Artificial Intelligence at University of Alberta.

SenseAct allows reinforcement learning agents written for OpenAIs popular "gym" simulator to learn behaviors for robots, by insulating them from the complexity of real-time control of robotic components. SenseActs guiding principles of minimizing delays and maximizing timing consistency via proactive computation lead to responsive learned behavior and reliable learning via state-of-the-art algorithms.

"This initial release focuses on tasks that explore timing, control frequency, action representation, partial observation, and sparse reward. We intend to update SenseAct as we define new tasks to reflect challenges in developing efficient, general, intuitive behaviors for our current and future products," says James Bergstra, Head of AI Research at Kindred.

SenseAct allows general reinforcement learning algorithms to learn diverse tasks on diverse robots, and is made freely available for anyone to explore and extend. For more information, visit www.kindred.ai/senseact

About Kindred

Founded in 2014, Kindred is building artificial intelligence for robotic grasping solutions. SORT, its first commercial product, is currently operating in major ecommerce retailers throughout the US. For more information, visit www.kindred.ai

Featured Product

Schmalz Technology Development - Vacuum Generation without Compressed Air - Flexible and Intelligent

Schmalz Technology Development - Vacuum Generation without Compressed Air - Flexible and Intelligent

• Vacuum generation that's 100% electrical; • Integrated intelligence for energy and process control; • Extensive communication options through IO-Link interface; Schmalz already offers a large range of solutions that can optimize handling process from single components such as vacuum generators to complete gripping systems. Particularly when used in autonomous warehouse, conventional vacuum generation with compressed air reaches its limits. Compressed air often is unavailable in warehouses. Schmalz therefore is introducing a new technology development: a gripper with vacuum generation that does not use compressed air. The vacuum is generated 100% electrically. This makes the gripper both energy efficient and mobile. At the same time, warehouses need systems with integrated intelligence to deliver information and learn. This enables the use of mobile and self-sufficient robots, which pick production order at various locations in the warehouse. Furthermore, Schmalz provides various modular connection options from its wide range of end effectors in order to handle different products reliably and safely.