Researchers turn 3D world into ‘projection screen' for better robot-to-human communication
Knowing exactly where and what task a robot will do next can help workers avoid injury.
Researchers at the Georgia Institute of Technology discovered a new way to improve human and robot safety in manufacturing scenarios by developing a method for robots to project their next action into the 3D world and onto any moving object.
"We can now use any item in our world as the ‘display screen instead of a projection screen or monitor," says Heni Ben Amor, research scientist in Georgia Techs School of Interactive Computing. "The robots intention is projected onto something in the 3D world, and its intended action continues to follow the object wherever that moves as long as necessary."
The discovery, born from two algorithms and a spare car door, is ideal for manufacturing scenarios in which both humans and robots assemble together. Instead of controlling the robot with a tablet or from a distant computer monitor, the human worker can safely stand at the robots side to inspect precision, quickly make adjustments to its work, or move out of the way as the robot and human take turns assembling an object. Knowing exactly where and what task a robot will do next can help workers avoid injury.
Watch Video Demonstration
"The goal of this research was to get information out of the virtual space inside the computer and into the real physical space that we inhabit," Ben Amor adds. "As a result of that, we can increase safety and lead to an intuitive interaction between humans and robots."
The discovery was developed over a four-month period by Ben Amor and Rasmus Andersen, a visiting Ph.D. student from Aalborg University in Denmark. The team realized that, by combining existing research available at Georgia Techs Institute for Robotics & Intelligent Machines (IRIM) with new algorithms, plus personal experience with auto manufacturers, they could make "intention projection" possible.
They first perfected algorithms that would allow a robot to detect and track 3D objects, beginning with previous research from Georgia Tech and Aalborg University that was further developed. They next developed a second set of entirely new algorithms that can display information onto a 3D object in a geometrically correct way. Tying these two pieces together allows a robot to perceive an object, then identify where on that object to project information and act, then continuously project that information as the object moves, rotates or adapts. Andersen led the coding.
IRIM has contributed previous research to BMW, Daimler AG, and Peugeot. The recent discovery was inspired by what Ben Amor had observed during earlier work with Peugeot in Paris and from Andersen's previous work on interaction with mobile robots. The group next plans to formally publish their research.
About the Georgia Tech College of Computing
The Georgia Tech College of Computing is a national leader in the creation of real-world computing breakthroughs that drive social and scientific progress. With its graduate program ranked 9th nationally by U.S. News and World Report, the Colleges unconventional approach to education is expanding the horizons of traditional computer science students through interdisciplinary collaboration and a focus on human-centered solutions. For more information about the Georgia Tech College of Computing, its academic divisions and research centers, please visit http://www.cc.gatech.edu.
Featured Product

3D Vision: Ensenso B now also available as a mono version!
This compact 3D camera series combines a very short working distance, a large field of view and a high depth of field - perfect for bin picking applications. With its ability to capture multiple objects over a large area, it can help robots empty containers more efficiently. Now available from IDS Imaging Development Systems. In the color version of the Ensenso B, the stereo system is equipped with two RGB image sensors. This saves additional sensors and reduces installation space and hardware costs. Now, you can also choose your model to be equipped with two 5 MP mono sensors, achieving impressively high spatial precision. With enhanced sharpness and accuracy, you can tackle applications where absolute precision is essential. The great strength of the Ensenso B lies in the very precise detection of objects at close range. It offers a wide field of view and an impressively high depth of field. This means that the area in which an object is in focus is unusually large. At a distance of 30 centimetres between the camera and the object, the Z-accuracy is approx. 0.1 millimetres. The maximum working distance is 2 meters. This 3D camera series complies with protection class IP65/67 and is ideal for use in industrial environments.