Keys to Mobile Manipulation: The Ability to See

Intelligent robots must be able to perceive the world around them.

15 Oct, 2020

author avatar
Today’s mobile manipulation systems are equipped with the ability to perceive the world using multi-spectrum sensing

Today’s mobile manipulation systems are equipped with the ability to perceive the world using multi-spectrum sensing

In our last article, we discussed Key #2 to mobile manipulation - The Ability to Interact. Today, we focus on the third key - The Ability to See


PERCEPTION SYSTEMS FOR ANY ENVIRONMENT

In today's robotics landscape, we see a variety of mobile platforms moving throughout structured industrial environments and performing critical tasks within warehouses. These platforms play an important role in transporting goods and materials indoors. However, for tasks that require interaction in an unstructured environment, intelligent mobile manipulation is required.

Unlike their predecessors, today’s mobile manipulation systems are equipped with the ability to perceive the world using multi-spectrum sensing including LIDAR, monocular vision, and stereo vision. 

Robots must be able to perceive and conceptualize the world around them. RE2's robotic systems, for instance, use third-party multi-modal 2D- and 3D-imaging sensors coupled with proprietary algorithms, called RE2 Detect, to perceive the world. RE2 Detect locates and tracks objects in just about any indoor or outdoor environment, whether in an operating room with bright, controlled illumination or outside on a rainy, overcast day.

In addition, RE2’s control algorithms close the control loop by continually adjusting the robotic arm’s position and orientation based on real-time vision processing and reporting. These methods are accelerated by customizing the input and processing hardware. Additionally, unlike typical industrial solutions that rely on 3D models to function, RE2 Detect leverages the geometric structure of objects, including their position, shape, or pose, to enable unique grasps for varied scenarios. In the next section, we will examine how RE2's intelligence modules uses the data collected from the object's geometric structure to decode, classify and ultimately "learn" from it.


Stop back for our next article, when we will feature Key #4: The Ability to Think. For access to the full eBook or to download additional technical eBooks and whitepapers, visit the Tech Resources section at the bottom of our Products page. 

15 Oct, 2020

More about RE2 Robotics

author avatar

RE2 Robotics develops the RE2 Sapien family of intelligent mobile manipulation systems that operate in a variety of complex indoor and outdoor environments for use in the aviation, construction, defense, energy, and medical industries. RE2’s mission is to develop mobile manipulation systems that em... learn more

Stay Informed, Be Inspired

Wevolver’s free newsletter delivers the highlights of our award winning articles weekly to your inbox.