What a UAV Can Do With Depth Perception

DARPA-funded effort demonstrates preciseautonomous payload placement with UAV.

When a person reaches out to place an object in just the right place, their mind makes a series of judgments requiring vision, stability and careful movement. Trying to do the same thing robotically from a hovering unmanned aerial vehicle (UAV) requires several technology advances. A DARPA-funded technology demonstration recently finished a successful testing of vision-driven robotic-arm payload emplacement using MLB Company's (Santa Clara, California) tail-sitter UAV, V-Bat. This UAV is capable of both hover and wing-borne flight, making the delivery and precision emplacement of a payload possible. A special robotic arm was designed with the capability of carrying up to 1 pound.


The research team designed and developed a low-cost vision system to estimate the target's position relative to the hovering vehicle in real time. This vision system enables the UAV to search and find the target for the emplacement autonomously and then perform the action.

DARPA's precision emplacement technology demonstration paves the way for precise long-range delivery of small payloads into difficult-to-reach environments.

"Our goal with the UAV payload emplacement demonstration was to show we could quickly develop and integrate the right technology to make this work," said Dan Patt, DARPA program manager. "The success of the demonstration further enables the capabilities of future autonomous aerial vehicles."

During this technology demonstration, the MLB Company-built V-Bat successfully demonstrated:

*A newly developed stereo vision system that tracks the emplacement target and motion of the robotic arm. The vision system, coupled with global positioning system, controls the arm and V-Bat during emplacement.

*Control logic to maneuver the vehicle and direct the robotic arm to accurately engage the emplacement target.

*Vehicle stability with the arm extended 6 feet with a 1-pound payload.

*Autonomous search and detection of the emplacement target and autonomously emplaced a 1-pound payload.


Featured Product

3D Vision: Ensenso B now also available as a mono version!

3D Vision: Ensenso B now also available as a mono version!

This compact 3D camera series combines a very short working distance, a large field of view and a high depth of field - perfect for bin picking applications. With its ability to capture multiple objects over a large area, it can help robots empty containers more efficiently. Now available from IDS Imaging Development Systems. In the color version of the Ensenso B, the stereo system is equipped with two RGB image sensors. This saves additional sensors and reduces installation space and hardware costs. Now, you can also choose your model to be equipped with two 5 MP mono sensors, achieving impressively high spatial precision. With enhanced sharpness and accuracy, you can tackle applications where absolute precision is essential. The great strength of the Ensenso B lies in the very precise detection of objects at close range. It offers a wide field of view and an impressively high depth of field. This means that the area in which an object is in focus is unusually large. At a distance of 30 centimetres between the camera and the object, the Z-accuracy is approx. 0.1 millimetres. The maximum working distance is 2 meters. This 3D camera series complies with protection class IP65/67 and is ideal for use in industrial environments.