Toyota Research Institute Reaches New Technical Milestones In Robotics
Latest Advances Demonstrate Adeptness at Complex Tasks in Home Environments
Today, Toyota Research Institute (TRI) unveiled new robotics capabilities aimed at solving complex tasks in home environments. Specifically, TRI roboticists were able to train robots to understand and operate in complicated situations that confuse most other robots, including recognizing and responding to transparent and reflective surfaces in a variety of circumstances.
As TRI demonstrates in a new video, this robust system allows robots to make generalizations in a range of scenarios, including in different homes. The video, released on National Selfie Day, takes a tongue in cheek approach to capturing these new capabilities on film, as the robot is seen recording itself as it proudly performs these new skills around the house.
"Our goal is to build robotic capabilities that amplify, not replace, human abilities," said Max Bajracharya, vice president of robotics at TRI. "Training robots to understand how to operate in home environments poses special challenges because of the diversity and complexity of our homes where small tasks can add up to big challenges."
While a human can easily differentiate between an object and its reflection, transparent or reflective items commonly found in the home befuddle today's robots. Since most robots are programmed to react to the objects and geometry in front of them without considering the context of the situation, they are easily fooled by a glass table, shiny toaster or transparent cup.
"To overcome this, TRI roboticists developed a novel training method to perceive the 3D geometry of the scene while also detecting objects and surfaces," continued Bajracharya. "This combination enables researchers to use large amounts of synthetic data to train the system." Using synthetic data also alleviates the need for time consuming, expensive, or impractical data collection and labeling.
While no system is perfect, today's announcement adds to the body of knowledge helping robots to reliably navigate and operate in home environments. This technical achievement enables a robot to quickly learn from "programmable data" - synthetic data to recreate and learn from past failures and is a promising milestone for TRI and roboticists everywhere.
About Toyota Research Institute
Toyota Research Institute (TRI), established in 2015, aims to develop active vehicle safety and automated driving technologies, robotics, and other human amplification technology. Led by Dr. Gill Pratt, TRI's researchers use artificial intelligence to benefit society and improve the human condition by creating a future where everyone has the freedom to move, engage, and explore. TRI is based in the United States, with offices in Los Altos, California, Cambridge, Massachusetts, and Ann Arbor, Michigan. For more information about TRI, please visit http://tri.global.
Featured Product
3D Vision: Ensenso B now also available as a mono version!
This compact 3D camera series combines a very short working distance, a large field of view and a high depth of field - perfect for bin picking applications. With its ability to capture multiple objects over a large area, it can help robots empty containers more efficiently. Now available from IDS Imaging Development Systems. In the color version of the Ensenso B, the stereo system is equipped with two RGB image sensors. This saves additional sensors and reduces installation space and hardware costs. Now, you can also choose your model to be equipped with two 5 MP mono sensors, achieving impressively high spatial precision. With enhanced sharpness and accuracy, you can tackle applications where absolute precision is essential. The great strength of the Ensenso B lies in the very precise detection of objects at close range. It offers a wide field of view and an impressively high depth of field. This means that the area in which an object is in focus is unusually large. At a distance of 30 centimetres between the camera and the object, the Z-accuracy is approx. 0.1 millimetres. The maximum working distance is 2 meters. This 3D camera series complies with protection class IP65/67 and is ideal for use in industrial environments.
