The lettuce's outer, or 'wrapper', leaves will be mechanically removed to expose the stem. Machine vision and artificial intelligence are then used to identify a precise cut point on the stem to neatly separate the head of lettuce.

Robot Solution for Automating the Lettuce Harvest
Robot Solution for Automating the Lettuce Harvest

Case Study from | IDS Imaging Development Systems

Lettuce is a valuable crop in Europe and the USA. But labor shortages make it difficult to harvest this valuable field vegetable, as sourcing sufficient seasonal labor to meet harvesting commitments is one of the sector's biggest challenges. Moreover, with wage inflation rising faster than producer prices, margins are very tight. In England, agricultural technology and machinery experts are working with IDS Imaging Development Systems GmbH (Obersulm, Germany) to develop a robotic solution to automate lettuce harvesting. The team is working on a project funded by Innovate UK and includes experts from the Grimme agricultural machinery factory, the Agri-EPI Centre (Edinburgh UK), Harper Adams University (Newport UK), the Centre for Machine Vision at the University of the West of England (Bristol) and two of the UK's largest salad producers, G's Fresh and PDM Produce.

Within the project, existing leek harvesting machinery is adapted to lift the lettuce clear from the ground and grip it in between pinch belts. The lettuce’s outer, or ‘wrapper’, leaves will be mechanically removed to expose the stem. Machine vision and artificial intelligence are then used to identify a precise cut point on the stem to neatly separate the head of lettuce.

"The cutting process of an iceberg is the most technically complicated step in the process to automate, according to teammates from G subsidiary Salad Harvesting Services Ltd.," explains IDS Product Sales Specialist Rob Webb. "The prototype harvesting robot being built incorporates a GigE Vision camera from the uEye FA family. It is considered to be particularly robust and is therefore ideally suited to demanding environments. "As this is an outdoor application, a housing with IP65/67 protection is required here," Rob Webb points out.

The choice fell on the GV-5280FA-C-HQ model with the compact 2/3" global shutter CMOS sensor IMX264 from Sony.

"The sensor was chosen mainly because of its versatility. We don't need full resolution for AI processing, so sensitivity can be increased by binning. The larger sensor format means that wide-angle optics are not needed either," Rob Webb summarized the requirements. In the application, the CMOS sensor convinces with excellent image quality, light sensitivity and exceptionally high dynamic range and delivers almost noise-free, very high-contrast 5 MP images in 5:4 format at 22 fps - even in applications with fluctuating light conditions.

The extensive range of accessories, such as lens tubes and trailing cables, is just as tough as the camera housing and the screwable connectors (8-pin M12 connector with X-coding and 8-pin Binder connector). Another advantage: camera-internal functions such as pixel pre-processing, LUT or gamma reduce the required computer power to a minimum.

The prototype of the robotic mower will be used for field trials in England towards the end of the 2021 season. "We are delighted to be involved in the project and look forward to seeing the results. We are convinced of its potential to automate and increase the efficiency of the lettuce harvest, not only in terms of compensating for the lack of seasonal workers,” affirms Jan Hartmann, Managing Director of IDS Imaging Development Systems GmbH.


Figure: Prototype lettuce harvesting robot of Agri-Epicentre (UK)
 

The challenges facing the agricultural sector are indeed complex. According to a forecast by the United Nations Food and Agriculture Organisation (FAO), agricultural productivity will have to increase by almost 50 percent by 2050 compared to 2012 due to the dramatic increase in population. Such a yield expectation means an enormous challenge for the agricultural industry, which is still in its infancy in terms of digitalization compared to other sectors and is already under high pressure to innovate in view of climatic changes and labor shortages.

The agriculture of the future is based on networked devices and automation. Cameras are an important building block, and artificial intelligence is a central technology here. Smart applications such as harvesting robots can make a significant contribution to this.


 

The content & opinions in this article are the author’s and do not necessarily represent the views of RoboticsTomorrow
IDS Imaging Development Systems Inc.

IDS Imaging Development Systems Inc.

World-class image processing and industrial cameras "Made in Germany". Machine vision systems from IDS are powerful and easy to use. IDS is a leading provider of area scan cameras with USB and GigE interfaces, 3D industrial cameras and industrial cameras with artificial intelligence. Industrial monitoring cameras with streaming and event recording complete the portfolio. One of IDS's key strengths is customized solutions. An experienced project team of hardware and software developers makes almost anything technically possible to meet individual specifications - from custom design and PCB electronics to specific connector configurations. Whether in an industrial or non-industrial setting: IDS cameras and sensors assist companies worldwide in optimizing processes, ensuring quality, driving research, conserving raw materials, and serving people. They provide reliability, efficiency and flexibility for your application.

Other Articles

AI image processing for high-gloss components in quality control
Highly reflective metallic surfaces are among the most challenging inspection targets in machine vision. Reflections obscure details, defects often only become visible from certain angles, and the quality of manual visual inspections fluctuates throughout the workday.
Automate 2026 Q&A with IDS Imaging
The U.S. is one of the most dynamic automation markets worldwide. Customers expect robust, scalable solutions, fast integration, and long-term reliability. Automate allows us to engage directly with OEMs, system integrators, and end users.
Time-of-Flight as a key technology for cost-sensitive 3D applications
In this article, Patrick Schick, Product Manager for 3D Vision at IDS, explains the background and technical decisions behind Nion, puts iToF technology into context, and highlights typical areas of application.
More about IDS Imaging Development Systems Inc.

Featured Product

US Digital's New L2 Low Profile Motor Encoder

US Digital's New L2 Low Profile Motor Encoder

The L2 incremental encoder uses US Digital's proven EM1 optical encoder module and disk, which has billions of device-hours of dependable service in customer applications. This product continues US Digital's strong reputation for reliable, field-tested encoders. The L2 is US Digital's lowest height encoder that uses the EM1 module. It has a 0.75 in. bolt-spacing mount. The maximum resolution is 1250 CPR (5000 PPR with quadrature). The L2 comes with a single-ended output. Another benefit of the L2 incremental encoder is its fast installation. The cover snaps onto the base to secure the module. It is designed for use with a high-retention connector or cable (sold separately). Like all US Digital products, the L2 is designed and manufactured in Vancouver, Washington, USA. It is backed by prompt access to our technical and customer service teams with same-day shipping on most orders.