As part of a research project, scientists at Nanyang Technological University, Singapore (NTU Singapore) have developed a robot that can independently assemble the individual components of an IKEA chair without interruption in less than ten minutes.

Furniture Assembly – with Ensenso N35
Furniture Assembly – with Ensenso N35

Contributed by | IDS Imaging Development Systems

As part of a research project, scientists at Nanyang Technological University, Singapore (NTU Singapore) have developed a robot that can independently assemble the individual components of an IKEA chair without interruption in less than ten minutes.

The robot consists of an Ensenso N35 3D camera from IDS and two robot arms equipped with grippers to pick up objects. The robot hardware is designed to simulate how people mount objects: the "eyes" are replaced by a 3D camera and the "arms" by industrial robot arms capable of moving in six axes. Each arm is equipped with parallel grippers for picking up objects. Force sensors are attached to the wrists to determine how strongly the "fingers" grip and how strongly they bring objects into contact with each other.

The robot starts the assembly process by taking 3D images of the parts lying on the ground to create a map of the estimated positions of the various components. This task is performed by an Ensenso 3D camera from IDS. The camera works according to the "projected texture stereo vision" principle (Stereo Vision), which imitates human vision. Two cameras acquire images from the same scene from two different positions. Although the cameras see the same scene content, there are different object positions according to the cameras’ projection rays. Special matching algorithms compare the two images, search for corresponding points and visualize all point displacements in a Disparity Map. The Ensenso software can determine the 3D coordination for each individual image pixel or object point, in this case the chair components.

 

Complexity of Robot Vision

The challenge is to locate the components as precisely, quickly and reliably as possible in a confusing environment. This is ensured by the Ensenso camera’s light-intensive projector. This produces a high-contrast texture on the object surface by using a pattern mask, even under difficult light conditions. The projected texture supplements the weak or non-existent object surface structure found on the components of the IKEA chair.

Although not required for this application, the N35 model used here even goes one step further: thanks to the integrated FlexView projector technology the pattern projected on the object surface of the components can be shifted to vary the texture on the surface. Acquiring multiple image pairs with different textures of the same object scene produces a lot more image points. Thus the components of the chair are displayed in 3D in a much higher resolution to make them easier for the robot to recognize. Another advantage is the robot hand-eye calibration function of the Ensenso software. Using a calibration plate, it ensures that the position of the camera coordinate system (in this case the stationary camera) is determined with respect to the base coordinate system (position of the component). This enables the robot's hand to react precisely to the image information and reaches exactly its destination.

 

Furniture assembly in less than ten minutes

"For a robot, putting together an IKEA chair with such precision is more complex than it looks," explains Professor Pham Quang Cuong of NTU. "The job of assembly, which may come naturally to humans, has to be broken down into different steps, such as identifying where the different chair parts are, the force required to grip the parts, and making sure the robotic arms move without colliding into each other. Through considerable engineering effort, we developed algorithms that will enable the robot to take the necessary steps to assemble the chair on its own." The result: the NTU robot installs the "Stefan" chair from Ikea in just 8 minutes and 55 seconds. According to Professor Pham Quang Cuong, artificial intelligence will make the application even more independent and promising in the future: "We are looking to integrate more artificial intelligence into this approach to make the robot more autonomous so it can learn the different steps of assembling a chair through human demonstration or by reading the instruction manual, or even from an image of the assembled product."

 

Outlook

The robot developed by the scientists at NTU Singapore is used for research into clever manipulation, an area of robotics that requires precise control of the forces and movements of special robot hands or fingers. This requires perfect interaction of all hardware and software components. 3D image processing using Ensenso stereo 3D cameras is the key to the solution. It convinces not only through accuracy, but also in terms of economy and speed. This marks real progress in furniture assembly – and not only here.

 

The content & opinions in this article are the author’s and do not necessarily represent the views of RoboticsTomorrow
IDS Imaging Development Systems Inc.

IDS Imaging Development Systems Inc.

IDS is a leading manufacturer of industrial cameras "Made in Germany" with USB or GigE interfaces. Equipped with state of the art CMOS sensors, the extensive camera portfolio ranges from low-cost project cameras, to small, powerful models with PoE functionality or robust cameras with housings that fulfill the prerequisites for protection code IP65/67. For quick, easy and precise 3D machine vision tasks IDS offers the Ensenso series. With the novel vision app-based sensors and cameras of IDS NXT the company opens up a new dimension in image processing. Whether in an industrial or non-industrial setting: IDS cameras and sensors assist companies worldwide in optimizing processes, ensuring quality, driving research, conserving raw materials, and serving people. They provide reliability, efficiency and flexibility for your application.

Other Articles

2D cameras for positioning and inspecting ultra-fine wires in semiconductor production
Wire bonding is a key process in semiconductor production. Extremely fine wires with diameters of 15 to 75 micrometers are used to create tiny electrical connections between a semiconductor chip and other components.
Picking the right chart - (Semi-)Autonomous surface and underwater mapping for rivers and lakes
On the camera side, the Fraunhofer Institute relies on two uEye FA industrial cameras from IDS. The robust and resilient models with PoE are ideal for demanding environments.
Pallet by pallet - Intelligent robotic vision system destacks up to 800 objects per hour
One of the locations where RODE adds value is for DHL eCommerce in Rotterdam. In this machine, two Ensenso 3D cameras from IDS Imaging Development Systems GmbH are implemented to provide the required image data.
More about IDS Imaging Development Systems Inc.

Comments (0)

This post does not have any comments. Be the first to leave a comment below.


Post A Comment

You must be logged in before you can post a comment. Login now.

Featured Product

Schmalz Technology Development - The Right Gripper for Every Task

Schmalz Technology Development - The Right Gripper for Every Task

In order to interact with their environment and perform the tasks, lightweight robots, like all industrial robots, depend on tools - and in many cases these are vacuum grippers. These form the interface to the workpiece and are therefore a decisive part of the overall system. With their help, the robots can pick up, move, position, process, sort, stack and deposit a wide variety of goods and components. Vacuum gripping systems allow particularly gentle handling of workpieces, a compact and space-saving system design and gripping from above. Precisely because the object does not have to be gripped, the vacuum suction cupenables gapless positioning next to each other.