In our last article, we discussed Key #2 to mobile manipulation - The Ability to Interact. Today, we focus on the third key - The Ability to See.
In today's robotics landscape, we see a variety of mobile platforms moving throughout structured industrial environments and performing critical tasks within warehouses. These platforms play an important role in transporting goods and materials indoors. However, for tasks that require interaction in an unstructured environment, intelligent mobile manipulation is required.
Unlike their predecessors, today’s mobile manipulation systems are equipped with the ability to perceive the world using multi-spectrum sensing including LIDAR, monocular vision, and stereo vision.
Robots must be able to perceive and conceptualize the world around them. RE2's robotic systems, for instance, use third-party multi-modal 2D- and 3D-imaging sensors coupled with proprietary algorithms, called RE2 Detect, to perceive the world. RE2 Detect locates and tracks objects in just about any indoor or outdoor environment, whether in an operating room with bright, controlled illumination or outside on a rainy, overcast day.
In addition, RE2’s control algorithms close the control loop by continually adjusting the robotic arm’s position and orientation based on real-time vision processing and reporting. These methods are accelerated by customizing the input and processing hardware. Additionally, unlike typical industrial solutions that rely on 3D models to function, RE2 Detect leverages the geometric structure of objects, including their position, shape, or pose, to enable unique grasps for varied scenarios. In the next section, we will examine how RE2's intelligence modules uses the data collected from the object's geometric structure to decode, classify and ultimately "learn" from it.
Stop back for our next article, when we will feature Key #4: The Ability to Think. For access to the full eBook or to download additional technical eBooks and whitepapers, visit the Tech Resources section at the bottom of our Products page.