Researcher <a href="https://www.linkedin.com/in/idil%C3%B6zdamar/" rel="noopener noreferrer" target="_blank">Idil Ozdamar</a> proposes a new telemanipulation framework that enables both the individual and combined control of any number of robotic arms.&nbsp;Teleoperation is a widely adopted strategy to control robotic manipulators executing complex tasks that require highly dexterous movements and critical high-level intelligence.&nbsp;Classical teleoperation schemes are based on either joystick control, or on more intuitive interfaces which map directly the user arm motions into one robot arm&#39;s motions. These approaches have limits when the execution of a given task requires reconfigurable multiple robotic arm systems.&nbsp;Indeed, the simultaneous teleoperation of two or more robot arms could extend the workspace of the manipulation cell, or increase its total payload, or afford other advantages. In different phases of a reconfigurable multi-arm system, each robot could act as an independent arm, or as one of a pair of cooperating arms, or as one of the fingers of a virtual, large robot hand.&nbsp;This manuscript proposes a novel telemanipulation framework that enables both the individual and combined control of any number of robotic arms. Thanks to the designed control architecture, the human operator can intuitively choose the proposed control modalities and the manipulators that make the task convenient to execute through the user interface.&nbsp;Moreover, through the tele-impedance paradigm, the system can address complex tasks that require physical interaction by letting the robot mimic the arm impedance and position references of the human operator. The proposed framework is validated with 8 subjects controlling &nbsp;4 Franka Emika robots with 7-DoFs to execute a telemanipulation task. Qualitative results of the experiments show us the promising applicability of our framework.Access the full paper <a href="https://www.researchgate.net/publication/362038178_A_Shared_Autonomy_Reconfigurable_Control_Framework_for_Telemanipulation_of_Multi-arm_Systems" rel="noopener noreferrer" target="_blank">here</a>.

Now it is possible to teleoperate individual and combined control of any number of robotic arms. Thanks to the designed control architecture, the human operator can intuitively create robot groups to control them together.


Controlling and Reconfiguring Multiple Collaborative Robot Arms

In this episode, we talk about how ostriches are inspiring a new generation of bipedal robots and the innovation enabling remote endovascular surgery. As always, you can find these and other interesting &amp; impactful engineering articles on Wevolver.com.<iframe height="200px" width="100%" frameborder="no" scrolling="no" seamless="" src="https://player.simplecast.com/e2238814-9212-4010-afb6-ac48d637140f?dark=false" class="fr-draggable" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true"></iframe><hr>This podcast is sponsored by <a href="https://www2.mouser.com/" id="isPasted" rel="nofollow" target="_blank">Mouser Electronics</a>.&nbsp;<img src="https://s3-us-west-1.amazonaws.com/wevolver-project-images/froala%2F1651565842197-Mouser-sponsor-1-a.jpg" style="width: 766px;" class="fr-fic fr-dib"><hr>(0:50) -&nbsp;<a href="https://www.wevolver.com/article/birdbot-a-3d-printed-bipedal-robot-offers-major-efficiency-gains-through-avian-biomimicry" target="_blank">Using Bird Biology To Make Efficient Walking Robots</a>(20:45) -&nbsp;<a href="https://www.wevolver.com/article/joystick-operated-robot-could-help-surgeons-treat-stroke-remotely" target="_blank">Joystick-operated Robot For Treating Strokes</a>Episode 68 was brought to you by Mouser Electronics, Farbod &amp; Daniel&rsquo;s favorite electronics distributor. Click <a href="https://www.mouser.com/applications/future-robotics-singularity/" target="_blank">here</a> to read the article discussing the merger of technology and humanity.<hr>About the podcast:Every day, some of the most innovative universities, companies, and individual technology developers share their knowledge on Wevolver. To ensure we can also provide this knowledge for the growing group of podcast listeners, we started a collaboration with two young engineers, Daniel Scott Mitchell &amp; Farbod Moghaddam who discuss the most interesting content in this podcast series.&nbsp;To learn more about this show, please visit the <a href="https://www.wevolver.com/profile/the.next.byte" target="_blank">shows page</a>. By following the page, you will get automatic updates by email when a new show is published.Be sure to give us a follow and review on <a href="https://podcasts.apple.com/nl/podcast/the-next-byte/id1548255861?l=en" rel="nofollow" target="_blank">Apple</a> podcasts, <a href="https://open.spotify.com/show/6lPPsRtegnivsRUEsQ09R7?si=IPMiah7xT_apJtPjqvXMlA" rel="nofollow" target="_blank">Spotify</a>, and most of your favorite podcast platforms!Take a few seconds to leave us a review. It really helps! <a href="https://apple.co/2RIsbZ2" rel="nofollow" target="_blank">https://apple.co/2RIsbZ2&nbsp;</a>if you do it and send us proof, we&rsquo;ll give you a shoutout on the show.

The prototype motorized BirdBot, seen here with legs in the locked position, uses a quarter the energy of its immediate predecessor.

In this episode, we talk about how ostriches are inspiring a new generation of bipedal robots and the innovation enabling remote endovascular surgery. 

Podcast: Bird-inspired Bipedal Robots & Robotic Surgeons

This article was discussed in our <a data-saferedirecturl="https://www.google.com/url?q=https://www.wevolver.com/profile/the.next.byte&source=gmail&ust=1651619086659000&usg=AOvVaw31M1Y-wsRw4c0h8-at-VxZ" href="https://www.wevolver.com/profile/the.next.byte" id="isPasted" rel="noopener noreferrer" target="_blank">Next Byte podcast</a>.&nbsp;<iframe height="200px" width="100%" frameborder="no" scrolling="no" seamless="" src="https://player.simplecast.com/e2238814-9212-4010-afb6-ac48d637140f?dark=false" class="fr-draggable" data-gtm-yt-inspected-1_19="true" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true"></iframe>The full article will continue below.<hr>This article was first published on <a href="https://news.mit.edu/2022/robot-stroke-treatment-remote-0413" id="isPasted" rel="noopener noreferrer" target="_blank">MIT News</a>. &nbsp;<hr>MIT engineers have developed a telerobotic system to help surgeons quickly and remotely treat patients experiencing a stroke or aneurysm. With a modified joystick, surgeons in one hospital may control a robotic arm at another location to safely operate on a patient during a critical window of time that could save the patient&rsquo;s life and preserve their brain function.The robotic system, whose movement is controlled through magnets, is designed to remotely assist in endovascular intervention &mdash; a procedure performed in emergency situations to treat strokes caused by a blood clot. Such interventions normally require a surgeon to manually guide a thin wire to the clot, where it can physically clear the blockage or deliver drugs to break it up.One limitation of such procedures is accessibility: Neurovascular surgeons are often based at major medical institutions that are difficult to reach for patients in remote areas, particularly during the &ldquo;golden hour&rdquo; &mdash; the critical period after a stroke&rsquo;s onset, during which treatment should be administered to minimize any damage to the brain.The MIT team envisions that its robotic system could be installed at smaller hospitals and remotely guided by trained surgeons at larger medical centers. The system includes a medical-grade robotic arm with a magnet attached to its wrist. With a joystick and live imaging, an operator can adjust the magnet&rsquo;s orientation and manipulate the arm to guide a soft and thin magnetic wire through arteries and vessels.The researchers demonstrated the system in a &ldquo;phantom,&rdquo; a transparent model with vessels replicating complex arteries of the brain. With just an hour of training, neurosurgeons were able to remotely control the robot&rsquo;s arm to guide a wire through a maze of vessels to reach target locations in the model.&ldquo;We imagine, instead of transporting a patient from a rural area to a large city, they could go to a local hospital where nurses could set up this system. A neurosurgeon at a major medical center could watch live imaging of the patient and use the robot to operate in that golden hour. That&rsquo;s our future dream,&rdquo; says Xuanhe Zhao, a professor of mechanical engineering and of civil and environmental engineering at MIT.Zhao and his team have <a href="https://www.science.org/doi/10.1126/scirobotics.abg9907" target="_blank">published their findings</a> today in Science Robotics. MIT co-authors include lead author Yoonho Kim, Emily Genevriere, and Jaehun Choe, along with Pablo Harker, Robert Regenhardt, Justin Vranic, Adam Dmytriw, and Aman Patel at Massachusetts General Hospital (MGH), and Marcin Balicki of Philips Research North America.<iframe src="https://www.youtube.com/embed/IYlHl6h8lm4?&wmode=opaque&rel=0&enablejsapi=1&origin=https://www.wevolver.com" frameborder="0" allowfullscreen="" class="fr-draggable" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true" style="width: 767px; height: 427px;" data-gtm-yt-inspected-1_19="true" id="391874016"></iframe><h2 id="isPasted">Tilt and twist</h2>Endovascular surgery is a specialized, minimally invasive procedure that involves carefully twisting and guiding a thin medical wire through the body&rsquo;s arteries and vessels to a target location, in a way that avoids damaging vessel walls. The procedure typically requires years of training for a surgeon to master.Robotic systems are being explored as assistive technologies in endovascular surgery. These systems mainly involve motor drives that advance and retract a wire while twisting it through the body&rsquo;s vasculature.&ldquo;But having a robot twist with the same level of sophistication [as a surgeon] is challenging,&rdquo; Kim notes. &ldquo;Our system is based on a fundamentally different mechanism.&rdquo;The team&rsquo;s new system builds on <a href="https://news.mit.edu/2019/robot-brain-blood-vessels-0828" target="_blank">work from 2019</a>, in which they demonstrated steering a magnetically controlled thread through a life-sized silicone model of the brain&rsquo;s blood vessels. They did so at the time using a handheld magnet, about the size of a soup can, that they manually manipulated.They have since affixed the magnet to the end of a medical-grade robotic arm, which can be steered using a small joystick knob on a mouse. By tilting the joystick, researchers can tilt the magnet in an orientation that a magnetic wire can follow. Buttons on the mouse control a set of motorized linear drives, which advance and retract the wire to make it move forward and back.The wire is as thin and flexible as a conventional neurovascular guidewire, with a soft, magnetically responsive tip that follows and bends in the direction of a magnetic field.<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjQ5OTIzNDk1NTU1LU1JVC1Sb2JvLVN0cm9rZS0wMi1wcmVzcy5qcGciLCJlZGl0cyI6eyJyZXNpemUiOnsid2lkdGgiOjk1MCwiZml0IjoiY292ZXIifX19" style="width: 766px;" class="fr-fic fr-dib">The MIT team envisions that its robotic system could be installed at smaller hospitals and remotely guided by trained surgeons at larger medical centers. Courtesy of the researchers<h2>Finding a path</h2>The team tested the robotic system in MGH&rsquo;s Catheter Lab &mdash; an operating room with standard medical imaging equipment used in endovascular procedures. The researchers installed the robotic arm in the lab, along with a life-sized silicone model of blood vessels. They set the joystick, along with a monitor displaying a live video of the model, in a control room. From there, an operator watched the video while using the joystick to remotely steer the wire through the vessels.The team trained a group of neurosurgeons to use the robotic system. After just one hour of training, each surgeon was able to successfully operate the system to guide the wire through complex vessels that are difficult to navigate with a manual guidewire.The team also used the robotic system to clear simulated clots in difficult-to-reach areas in the model. They steered the guidewire through vessels, and around sharp corners and turns, to reach regions where the researchers simulated clots. Once they guided the wire to the clot, the surgeons proceeded with standard endovascular methods to thread a microcatheter along the wire to the site of the clot. They retracted the wire, leaving the catheter, which they then applied to successfully remove the clot.&ldquo;The primary purpose of the magnetic guidewire is to get to the target location quickly and safely, so that standard devices like microcatheters can be used to deliver therapeutics,&rdquo; Kim says. &ldquo;Our system is like a pathfinder.&rdquo;He hopes that the teleoperated system can help more patients receive time-critical treatment. He also sees benefits for surgeons, who typically perform such vascular procedures in the same room as the patient, while being exposed to radiation from X-ray imaging.&ldquo;The neurosurgeons can operate the robot in another room or even in another city without repeated exposure to X-rays,&rdquo; Zhao says. &ldquo;We are truly excited about the potential impact of this technology on global health, given that stroke is one of the leading causes of death and long-term disability.&rdquo;<hr>&quot;Reprinted with permission of <a href="https://news.mit.edu/2022/robot-stroke-treatment-remote-0413" id="isPasted" rel="noopener noreferrer" target="_blank">MIT News</a>&quot;&nbsp;

MIT engineers developed a telerobotic system to help surgeons remotely treat patients experiencing stroke or aneurysm. With a modified joystick, surgeons may control a robotic arm at another hospital to operate on a patient. Courtesy of the researchers

The system could provide teleoperated endovascular treatment to patients during the critical time window after a stroke begins.

Joystick-operated robot could help surgeons treat stroke remotely

The Robot Teleoperativo is a new robotics result achieved at IIT-Istituto Italiano di Tecnologia and combining the rugged locomotion of HyQReal robot with dexterous and powerful manipulation assured by a new robotic arm, controlled by immersive VR visualization and haptic teleoperation. It represents a significant contribution to the state-of-the-art robotics dedicated to intervention on unstructured, difficult terrain environments, requiring powerful capabilities. The human operator can always be in control, not being replaced by the robot but substituted and assisted by it, in the case of situations where humans may be exposed to risks for their health, such as disaster response or emergency in nuclear, marine, chemical, oil-&amp;amp;-gas, environments.In a new video, researchers show the achieved results: the Robot Teleoperativo is able to open doors, access fire equipment, gather precious items, navigate in the dark, and walk over difficult terrain. The video will be showed during the international conference ICRA 2021, on May 31st.With the effective execution of such tasks, albeit in simulated lab setup scenarios, the three years of developmental research in the Robot Teleoperativo project has shown that although the challenge of substituting human workers is a difficult one, it is certainly not an insurmountable one.The project is a result of the close collaboration between IIT-Istituto Italiano di Tecnologia and INAIL (Italian National Worker’s Compensation Authority). The 3-year project started in 2017 with an aim to enhance occupational safety and health (OSH) in demanding and dangerous occupations. The goal was to keep the worker who is engaged in high-risk interventions in demanding environments, at the core of the development; researchers worked with firefighters to define specific needs and they will further explore the use of Robot Teleoperativo in realistic scenario.Robot Teleoperativo consists of two modules, the field robot and the pilot station. The field robot integrates the versatile locomotion of the HyQReal hydraulic quadruped robot with the dexterity and power of the INAIL-IIT multi-degrees-of-freedom (DOFs) robotic arm. At the pilot station, the 6-DOF haptic teleoperation device REMOTArm, including the 3-finger HEXOTrAc-Plus hand exoskeleton, combines with the 3D virtual reality (VR) based intuitive, information-rich interface for perception, interaction, and teleoperation. The field-pilot&nbsp;combination offers an immersive telepresence experience to the operator (worker), allowing them to project their actions to and perceive the information from the remote environment through the field robot.The HyQReal quadruped, with its 90 cm height, 133 cm length, and 130 kilograms of weight, demonstrated in 2019 being able to develop sufficient force to tow a passenger plane of over three tons. With its advanced locomotion, the HyQReal is capable of navigating difficult terrain, characterized by slopes, stairs, or debris, with a degree of mobility far greater than in the case of wheeled or tracked vehicles. The HyQReal is equipped with a variety of cameras and multimodal sensors for real-time environment perception.INAIL-IIT arm is a robotic manipulator with strength and dexterity. The 5-DOF serial robotic arm provides the ability to interact with, and manipulate the environment with robustness, precision, and power. It is about 1.0m in length, and has a 4 kg payload capacity. Its 5 joints integrate compact and lightweight, torque controlled actuators, which allow the manipulator arm to operate in position and / or torque-control depending on the task. The HERI II robotic hand, with its multi-finger configuration, combines strength and dexterity for grasping heavy as well as delicate objects.REMOTArm is the haptic teleoperation pilot interface for precise tele-manipulation. The REMOTArm is a desk-mounted, 6-DOF, haptic teleoperation device. It tracks the position and orientation of the operator’s wrist with high accuracy, and offers a much larger workspace than similar commercial devices. It provides 3-DOF force feedback at the wrist (&gt; 20N). The 3-finger HEXOTrAc-Plus hand exoskeleton is an ergonomic haptic glove that accurately tracks the operator’s gestures when tele-manipulating the field manipulator. Its actuators can display the remotely sensed interaction forces (&lt; 10 N) to the user at the robotic hand as they happen. The interface is lightweight, easy-to-wear, and includes gravity compensation for user comfort.The operator uses a VR system for an immersive 3D perception of the remote environment. The user interface, using commercial head-mount display devices and VR software, makes for an intuitive and effective real-time projection of the field of action for the remote operator. Using the multimodal vision, depth, and ambient sensing system on-board the field robot, the interface “reconstructs” the remote field context for the operator, providing an information-rich interface for perception, interaction, and control.This successful outcome has encouraged researchers to push the boundaries of technological innovation further. IIT and INAIL continue their close collaboration in this field aiming at expanding the possibilities in remote telerobotics research and its transition from the lab to the real hazardous work environments.<hr>Further informationThe research study was coordinated by Nikhil Deshpande, Researcher at IIT’s Advanced Robotics Line, and involved the research groups led by Claudio Semini (for HyQReal), Nikolaos Tsagarakis (for manipulation) and Ioannis Sarakoglou (for teleoperation) at IIT in Genova (Italy).&nbsp;Website: <a href="https://advr.iit.it/projects/inail-scc/teleoperazione" target="_blank">https://advr.iit.it/projects/inail-scc/teleoperazione</a>

The Robot Teleoperativo is a new robotics result achieved at IIT-Istituto Italiano di Tecnologia and combining the rugged locomotion of HyQReal robot with dexterous and powerful manipulation assured by a new robotic arm, controlled by immersive VR visualization and haptic teleoperation.