Real-time behaviour synthesis for dynamic Hand-Manipulation
From Vikash Kumar at University of Washington:
Dexterous hand manipulation is one of the most complex types of biological movement, and has proven very difficult to replicate in robots. The usual approaches to robotic control - following pre-defined trajectories or planning online with reduced models - are both inapplicable. Dexterous manipulation is so sensitive to small variations in contact force and object location that it seems to require online planning without any simplifications. Here we demonstrate for the first time online planning (or model-predictive control) with a full physics model of a humanoid hand, with 28 degrees of freedom and 48 pneumatic actuators. We augment the actuation space with motor synergies which speed up optimization without removing flexibility. Most of our results are in simulation, showing nonprehensile object manipulation as well as typing. In both cases the input to the system is a high level task description, while all details of the hand movement emerge online from fully automated numerical optimization. We also show preliminary results on a hardware platform we have developed "ADROIT" - a ShadowHand skeleton equipped with faster and more compliant actuation... (website)
Records 1 to 1 of 1
Featured Product
NVIDIA RTX PRO BLACKWELL DESKTOP GPUs
NVIDIA RTX PRO - Built for Professionals - NVIDIA RTX PRO Blackwell Desktop GPUs feature the latest breakthroughs in AI, ray tracing, and neural rendering technology to power the most innovative workflows in design, engineering, and beyond.
Robotics and Automation - Featured Company
e-con Systems
Since 2003, e-con Systems® has been designing, developing & manufacturing custom and off-the-shelf OEM camera solutions. Backed by a large in-house team of experts, our cameras are currently embedded in 350+ customer products. So far, we have shipped over 2 million cameras to the USA, Europe, Japan, South Korea, & more. Our portfolio includes MIPI, GMSL, GigE, USB cameras, ToF & Stereo cameras & smart AI cameras. They come with industry-leading features, including low-light performance, HDR, global shutter, LED flicker mitigation, multi-camera synchronization, & IP69K-rated enclosure. e-con Systems® also offers TintE™ - an FPGA-based ISP with all necessary imaging pipeline components. It provides a full ISP pipeline as a turnkey solution, featuring optimized, customizable blocks like debayering, AWB, AE, gamma correction and more. Our powerful partner ecosystem, comprising sensor partners, ISP partners, carrier board partners, & more, enables us to offer end-to-end vision solutions.
