According to Universal Robots (UR), in 2019, around 38 per cent of the manufacturing labor force still moved parts manually between bins and manufacturing machines, rather than use industrial robots.

Overcoming the Challenges of Automated Bin Picking
Overcoming the Challenges of Automated Bin Picking

Claudia Jarrett, US country manager | EU Automation

According to Universal Robots (UR), in 2019, around 38 per cent of the manufacturing labor force still moved parts manually between bins and manufacturing machines, rather than use industrial robots. Why the slow adoption? For designers and engineers of industrial robots, the random nature of automated bin picking presents some of the biggest challenges. Here, Claudia Jarrett, US country manager for industrial automation supplier EU Automation, explains why better 3D vision systems are the answer.

The act of picking-up and randomly sorting objects may come naturally for humans, who can perform the task countless times each day. However, it’s much harder for robots, which rely on 3D vision systems, data and programming rather than innate intelligence. 

Production line applications for robots have historically been repetitive, from the first industrial robot systems that appeared on General Motors’ US assembly lines in the 1960s, to modern tasks like screwing lids on bottles. In contrast, bin picking invites all kinds of random external factors.

Automated bin-picking robots can reduce the time and costs manufacturers normally spend on these applications, while freeing up human workers to focus on more productive and valuable tasks. But, if that’s true, why were around 38 per cent of the manufacturing labor force still moving parts manually in 2019? 

Let’s look at some of the major challenges of automated bin picking, and what manufacturers can do to overcome them. 


Exceptional vision

Bin picking robots are required to handle objects that may be tiny, thin, porous or deformable. The objects might be densely packed, or piled on top of each other. For instance, let’s imagine bottles are lying randomly in a bin, and must be picked and placed on a conveyer belt. A robot interacting with a production line will usually be placed in the same position, every time. So, if the chain suddenly accelerates or decelerates or a product ― let’s say a bottle ― falls over, the robot’s programmed movements will not adapt to this. 

A robot would need exceptional vision and sensors. First, to negotiate and grab the randomly-positioned bottles and, second, to perform its task without damaging any bottles. Because robots rely on wide baseline cameras, they can miss objects ― if, for instance, they are obscured by shadows ― or perform mispicks. In short, bin picking involves an array of tasks that are never the same, which many robots are ill-equipped to contend with.

Another issue for industrial robots are shiny, reflective objects — examples include products with shiny metal surfaces, or that are wrapped in plastic. Light reflected by these surfaces can cause point cloud artifacts, or irregularities, which interfere with the 3D vision systems robots rely upon. These systems determine   the location where robots need to pick an object from, and communicate how they need to position the picking arm. However, reflection interferes with the necessary data quality and CAD matching processes, which can cause the robot to perform faulty calculated picking positions.

These issues often arise from inadequate vision systems. Less-expensive 2D and 3D vision cameras are affordable for smaller manufacturers, but many of them are not optimized for piece picking applications.  Robots might be able to detect objects with such a solution, but they cannot pick them every time due to scaling, rotation or translation errors.

Instead, advanced 3D vision systems are needed that can quickly recognise objects of similar shapes, colors and material. After all, fast sorting is one of the major advantages of bin picking robots — in some cases, the process has been known to double time and costs when performed with humans.

A popular choice are solutions by Norway’s Zivid, which develops industrial 3D machine vision cameras and vision software. The company’s industrial Zivid 3D cameras, for instance, offer optimized resolution, precision and trueness to reliably capture both the fine details for large parts, as well as the tiny and thin objects. 

Other solutions are designed to overcome the effects of point cloud artifacts in automated bin picking. The new Zivid SDK 2.0, for instance, features a special artifacts correction filter that the developers describe as “groundbreaking”. The technology’s patented Artifact Reduction Technology (ART) also uses a Zivid Two 3D camera, specifically designed to handle reflections caused by shiny surfaces.


Robots for all

UR’s report also observed that most real-world bin picking deployments were found at large, sophisticated manufacturers like automotive original equipment manufacturers (OEMs). Yet, at the same time, most bins and manufacturing machines are found within small-medium-enterprises (SMEs), which have the least capital and expertise required to create a bin picking system. Therefore, SMEs need cost-effective bin picking solutions that can be easily used by non-experts and newly-trained staff. 

Energid is among the companies helping to democratize automated bin picking. It offers a complete pre-integrated system with all the necessary complexity, including sensor configurations, imaging and path planning. The system is pre-figured within software previously used in mission-critical applications for NASA spacecraft, and in autonomous robots for oil drilling platforms and surgical applications. 

Users can simply plug-in and use the robot with no setup required.  This reduces installation time to mere hours. The installation and training time are minimal, according to Energid. The robot then performs its tasks without the need for user-defined waypoints or tuning. 

Elsewhere, designers and engineers of industrial robots are attempting to apply Deep Learning techniques to automated bin picking applications. Although artificial intelligence (AI) is very effective for image classification, the results have so-far been disappointing, given the random nature of bin picking. 

As robots and smart sensors increasingly prove their worth, the support of an industrial parts supplier can be vital in helping manufacturers choose the right sensor for their packaging application. Parts suppliers, like EU Automation, can  source sensors for packagers, ensuring the transition can be achieved without requiring a complete overhaul. 

Such advancements, along with ground-breaking technologies like sensor networks and the IoT, can help ensure that robots can handle the moving of parts between bins and manufacturing machines, freeing-up humans workers to focus on more demanding and valuable tasks. 

The content & opinions in this article are the author’s and do not necessarily represent the views of RoboticsTomorrow

Comments (0)

This post does not have any comments. Be the first to leave a comment below.

Post A Comment

You must be logged in before you can post a comment. Login now.

Featured Product

BitFlow Introduces 6th Generation Camera Link Frame Grabber: The Axion

BitFlow Introduces 6th Generation Camera Link Frame Grabber: The Axion

BitFlow has offered a Camera Link frame grabbers for almost 15 years. This latest offering, our 6th generation combines the power of CoaXPress with the requirements of Camera Link 2.0. Enabling a single or two camera system to operate at up to 850 MB/S per camera, the Axion-CL family is the best choice for CL frame grabber. Like the Cyton-CXP frame grabber, the Axion-CL leverages features such as the new StreamSync system, a highly optimized DMA engine, and expanded I/O capabilities that provide unprecedented flexibility in routing. There are two options available; Axion 1xE & Axion 2xE. The Axion 1xE is compatible with one base, medium, full or 80-bit camera offering PoCL, Power over Camera Link, on both connectors. The Axion 2xE is compatible with two base, medium, full or 80-bit cameras offering PoCL on both connectors for both cameras. The Axion-CL is a culmination of the continuous improvements and updates BitFlow has made to Camera Link frame grabbers.