Robot Learning Manipulation Action Plans by "Watching" Unconstrained Videos from the World Wide Web

From Yezhou Yang, Yi Li, Cornelia Fermuller and Yiannis Aloimonos:

In order to advance action generation and creation in robots beyond simple learned schemas we need computational tools that allow us to automatically interpret and represent human actions. This paper presents a system that learns manipulation action plans by processing unconstrained videos from the World Wide Web. Its goal is to robustly generate the sequence of atomic actions of seen longer actions in video in order to acquire knowledge for robots. The lower level of the system consists of two convolutional neural network (CNN) based recognition modules, one for classifying the hand grasp type and the other for object recognition. The higher level is a probabilistic manipulation action grammar based parsing module that aims at generating visual sentences for robot manipulation.


The list of the grasping types.

Experiments conducted on a publicly available unconstrained video dataset show that the system is able to learn manipulation actions by “watching” unconstrained videos with high accuracy.... (article at Kurzweilai.net) (original paper)

2014 Robotics In A Word: "MORE"

The list of top stories in robotics for 2014 is a story of "MORE": MORE uses of and for robots; MORE serious discussions about robots; MORE robots in unusual places; MORE news in the financial press; MORE funding, acquisitions and IPOs; and MORE choices.

Booming Holiday Drone Sales Creates Unknown Safety Risk

With thousands of drones given as holiday gifts this year, thousands more untested operators are about to launch their gifts into the sky, creating a mass safety risk of unknown proportions, according to Darrell Slaughter, Director of Business Development at Phoenix, Arizona-based Unmanned Vehicle University (UVU).

2015CES - INMOTION to Showcase New Self-balancing Smart Vehicles at the 2015 Consumer Electronics Show

The Newest Smart Sensor Control Vehicles to be Demonstrated for the Media at Pepcom's Digital Experience

Intuitive Robot Programming for Flexible Aerospace Manufacturing

Robots are proving to be flexible tools for aircraft manufacturing and assembly. Their full potential however can be limited by the challenges of programming a robot in a CAD/CAM environment. Software that integrates offline programming, simulation, code generation, and path optimization makes the process seamless and error-free.

ZOOM IN, ZOOM OUT: SPEEDY, AGILE UAVS ENVISIONED FOR TROOPS IN URBAN MISSIONS

DARPA aims to give small unmanned aerial vehicles advanced perception and autonomy to rapidly search buildings or other cluttered environments without teleoperation

World's First Robotic Entertainment On The High Seas For Royal Caribbean International

Royal Caribbean Cruise Lines, Robotic Arts and ABB Robotics join forces to debut groundbreaking RoboScreen® entertainment system.

ABB to exhibit at International CES for the first time, featuring innovative robotic technology at the 2015 show in Las Vegas

Highlights include two sizes of patented RoboScreen system, and smallest 6-axis robot, ideal for electronic products assembly

John Carmack On Modern C++

Winter break homework from John Carmack. Gamasutra reprint article "In-depth: Functional programming in C++":

A large fraction of the flaws in software development are due to programmers not fully understanding all the possible states their code may execute in. In a multithreaded environment, the lack of understanding and the resulting problems are greatly amplified, almost to the point of panic if you are paying attention. Programming in a functional style makes the state presented to your code explicit, which makes it much easier to reason about, and, in a completely pure system, makes thread race conditions impossible... (full article)

Also "Lessons to learn from Oculus development team when using the “Modern C++” approach":

Modern C++ doesn’t imply necessarly the overuse of templates

Andrei Alexandrescu says about the Modern C++ design:

"Modern C++ Design defines and systematically uses generic components - highly flexible design artifacts that are mixable and matchable to obtain rich behaviors with a small, orthogonal body of code."

Modern C++ has a close relation with generic programming; probably it’s the reason that makes many developers neglect the modern C++ approach. They think that the code will be mostly implemented as templates, which makes the code difficult to read and maintain.

In the SDK, the templates represent only 20% of all types defined and most of them are related to the technical layer... (full article)

LORD MicroStrain Wins Manufacturing Leadership Award

LORD Corporation MicroStrain® Sensing Systems was recently selected by Energy Harvesting Journal for having the "Best Technical Development of an Energy Harvesting Device."

TUSExpo reveals speakers line-up

TUSExpo, the first fully integrated European trade show and conference focused on the Unmanned Systems industry, has revealed its line-up of speakers.

University of Pittsburgh Team Publishes New Findings from Mind-Controlled Robot Arm Project

In another demonstration that brain-computer interface technology has the potential to improve the function and quality of life of those unable to use their own arms, a woman with quadriplegia shaped the almost human hand of a robot arm with just her thoughts to pick up big and small boxes, a ball, an oddly shaped rock, and fat and skinny tubes.

Humanistic Robotics and Critical Solutions International (CSI) Partner to Offer Comprehensive Route Clearance Package

HRI landmine and IED rollers complement CSI's Husky vehicle to create a safer route clearance toolbox for the end user

QinetiQ North America Wins Two TALON Contracts

U.S. Army and U.S. Navy refurbish TALON Counter IED Robots

Wood Component Manufacturer Lays the Groundwork for Growth with Collaborative Robotics

At Walnut Creek Planing, Rethink Robotics' Baxter is Feeding Wood-Shaping Machines and Facilitating Smooth Transitions on New Lines

Records 1831 to 1845 of 6288

First | Previous | Next | Last

Industrial Robotics - Featured Product

OCTOPUZ Robot Programming Software

OCTOPUZ Robot Programming Software

Program and simulate ALL your robots with OCTOPUZ offline software. OCTOPUZ specializes in path sensitive robotic applications such as welding, fabrication, edge following (waterjet, deburring, laser cutting), material removal (2D & 3D machining), and pick & place. Easy to learn, it directly supports paths from your favorite CAM system, has a library of over 15 different types of robot brands, can cut path generation by over 50% and is fully customizable to your unique needs. Program and simulate multiple robots simultaneously in any configuration! Responsive technical assistance from OCTOPUZ before, during and after sale via training, support and cell development make OCTOPUZ the software of choice.