Honeybees are famously finicky when it comes to being studied. Research instruments and conditions and even unfamiliar smells can disrupt a colony&rsquo;s behavior. Now, a joint research team from the <a href="https://www.epfl.ch/labs/mobots/" target="_blank">Mobile Robotic Systems Group</a> in EPFL&rsquo;s School of Engineering and School of Computer and Communication Sciences and the <a href="https://www.hiveopolis.eu/uni-graz/" rel="noopener" target="_blank">Hiveopolis</a> project at Austria&rsquo;s University of Graz have developed a robotic system that can be unobtrusively built into the frame of a standard honeybee hive.Composed of an array of thermal sensors and actuators, the system measures and modulates honeybee behavior through localized temperature variations.&ldquo;Many rules of bee society &ndash; from collective and individual interactions to raising a healthy brood &ndash; are regulated by temperature, so we leveraged that for this study,&rdquo; explains EPFL PhD student Rafael Barmak, first author on a paper on the system recently <a href="https://doi.org/10.1126/scirobotics.add7385" rel="noopener" target="_blank">published</a> in Science Robotics.&nbsp;&ldquo;The thermal sensors create a snapshot of the bees&rsquo; collective behavior, while the actuators allow us to influence their movement by modulating thermal fields.&rdquo;&ldquo;Previous studies on the thermal behavior of honeybees in winter have relied on observing the bees or manipulating the outside temperature,&rdquo; adds Martin Stefanec of the University of Graz. &ldquo;Our robotic system enables us to change the temperature from within the cluster, emulating the heating behavior of core bees there, and allowing us to study how the winter cluster actively regulates its temperature.&rdquo;<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjc5NTgwNzYzMDM4LWV6Z2lmLTMtYWVmZmI5YzZiOS5qcGciLCJlZGl0cyI6eyJyZXNpemUiOnsid2lkdGgiOjk1MCwiZml0IjoiY292ZXIifX19" style="width: 766px;" class="fr-fic fr-dib"> The robotic system is shown in an experimental hive &copy; Artificial Life Lab/U. of Graz/Hiveopolis&nbsp;<h2>A &lsquo;biohybrid superorganism&rsquo; to mitigate colony collapse</h2>Bee colonies are challenging to study in winter since they are sensitive to cold, and opening their hives risks harming them in addition to influencing their behavior. But thanks to the researchers&rsquo; biocompatible robotic system, they were able to study three experimental hives, located at the Artificial Life Lab at the University of Graz, during winter and to control them remotely from EPFL. Inside the device, a central processor coordinated the sensors, sent commands to the actuators, and transmitted data to the scientists, demonstrating that the system could be used to study bees with no intrusion &ndash; or even cameras &ndash; required.Mobile Robotic Systems Group head Francesco Mondada explains that one of the most important aspects of the system &ndash; which he calls a &lsquo;biohybrid superorganism&rsquo; for its combination of robotics with a colony of individuals acting as a living entity &ndash; is its ability to simultaneously observe and influence bee behavior.&ldquo;By gathering data on the bees&rsquo; position and creating warmer areas in the hive, we were able to encourage them to move around in ways they would never normally do in nature during the winter, when they tend to huddle together to conserve energy. This gives us the possibility to act on behalf of a colony, for example by directing it toward a food source, or discouraging it from dividing into too-small groups, which can threaten its survival.&rdquo;The scientists were able to prolong the survival of a colony following the death of its queen by distributing heat energy via the actuators. The system&rsquo;s ability to mitigate colony collapse could have implications for bee survivability, which has become a growing environmental and food security concern as the pollinators&rsquo; global populations have declined.<h2>Never-before-seen behaviors</h2>In addition to its potential to support colonies, the system has shed light on honeybee behaviors that have never been observed, opening new avenues in biological research.&ldquo;The local thermal stimuli produced by our system revealed previously unreported dynamics that are generating exciting new questions and hypotheses,&rdquo; says EPFL postdoctoral researcher and corresponding author Rob Mills. &ldquo;For example, currently, no model can explain why we were able to encourage the bees to cross some cold temperature &lsquo;valleys&rsquo; within the hive.&rdquo;The researchers now plan to use the system to study bees in summertime, which is a critical period for raising young. In parallel, the Mobile Robotic Systems Group is exploring systems using vibrational pathways to interact with honeybees.&ldquo;The biological acceptance aspect of this work is critical: the fact that the bees accepted the integration of electronics into the hive gives our device great potential for different scientific or agricultural applications,&rdquo; says Mondada.<hr>ReferencesR. Barmak and M. Stefanec, D. N. Hofstadler, L. Piotet, S. Sch&ouml;nwetter-Fuchs-Schistek, F. Mondada, T. Schmickl, R. Mills (2023) A robotic honeycomb for interaction with a honeybee colony. Science Robotics, vol 8, Issue 76. <a href="https://doi.org/10.1126/scirobotics.add7385" rel="noopener" target="_blank">https://doi.org/10.1126/scirobotics.add7385</a>

The robotic system is shown in an experimental hive © Artificial Life Lab/U. of Graz/Hiveopolis

EPFL researchers have developed a temperature-modulating robotic system that can be seamlessly integrated into notoriously sensitive honeybee hives, providing both a never-before-seen view of honeybee behavior and a means to influence it.

Robotic system offers hidden window into collective bee behavior

Traditional non-destructive testing methods for industrial assets require sending inspectors to elevated and confined areas using scaffolding or rope access. This method is expensive, time-consuming, and dangerous.Avestec has developed a solution using intelligent robots that fly, attach, and measure. Completing all inspection requirements quickly, safely, and at a low cost.With the technology of intelligent flying robots, what once took an entire inspection team for ten days can be completed by two operators in a single day.Unlimited flight and a patented attachment mechanism enable our robots to perform Ultrasonic Thickness measurements and visual inspections easily.A cloud-based reporting software like Avesoft handles all the post-processing and data analysis using artificial intelligence and automatically generates reports. So well-informed decisions can be made faster.

Intelligent flying robots are making their way into the Non-Destructive Testing industry.
These robots are gaining attention in providing the industry with a safer and superior alternative to traditional methods.

Flying into Non-Destructive Testing

Another fascinating month for robotics. Researchers are the highlight of the month. Through their work, we are pushing the boundaries of self-awareness, complex structure and even the limits of life and death.&nbsp;Spoooky indeed.&nbsp;Take a seat and join us in this quick review of robotics news.And don&#39;t forget that you can also share your story. We would love to feature it in our next blog. Just email us at <a href="mailto:robotics.community@canonical.com" target="_blank">robotics.community@canonical.com</a><ul><li>This blog has also been <a href="http://ubuntu.com/blog/the-state-of-robotics-august-2022?utm_source=wevolver&utm_medium=blog" rel="noopener noreferrer" target="_blank">posted in Ubuntu blogs</a>.&nbsp;</li></ul><h2 dir="ltr">Security for robotics</h2><h3 dir="ltr">Vulnerability in cute, smart Enabot Ebo Air robot found and fixed</h3>The <a href="https://na.enabot.com/ebo/AIR" target="_blank">Enabot Ebo Air</a> is a friendly smart home robot, designed to keep the family company. It allows you to interact with your family at home while you&rsquo;re away. It can take photos and videos as well as recognise faces, and you can steer it around the house via Wi-Fi. Recently, the security assessment firm Modux was asked to evaluate the security of the robot, and <a href="https://www.modux.co.uk/post/serious-security-issues-uncovered-with-the-enabot-smart-robot" target="_blank">found two important vulnerabilities</a>. Modux disclosed the issues to the manufacturer, who has since addressed the risks and released a fix.&nbsp;<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjYwNTU1ODQzODQ3LXRlc3QgMS53ZWJwIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" style="width: 300px;" class="fr-fic fr-dib">The first issue found was the use of a shared password for the system administrator (root) account. The Enabot Ebo Air robot came pre-configured with a default system administrator password, which was weak and shared across all devices. An attacker could have used this to connect via SSH (secure shell), and gain full administrative permissions. The recommendation was to disable SSH functionality, which the manufacturer did.&nbsp;The second bug was a missing secure-delete functionality, which could potentially disclose information from the previous owner if the robot was resold. The robot did not effectively perform a secure deletion of data when a factory reset was initiated, leaving behind artefacts from previous uses of the device, including cleartext Wi-Fi passwords and session tokens from the previous owner. For this, the recommendation was to use a secure deletion functionality instead, overwriting all sensitive data multiple times.An attacker could have used these vulnerabilities to move the robot, access the camera, record video, speak through the microphone, among other tasks, effectively using it as a surveillance device. This event highlights the importance of security awareness and thorough testing, as robots continue to serve and accompany us more and more in our daily lives. <h2 dir="ltr">Amazon acquisition of iRobot - implications beyond data</h2>Every time Amazon launches or acquires a new company (especially one developing a device) the whole internet starts talking about the data and privacy implications. Yes, certainly data is important for Amazon. But that is not the whole story. Today I want to talk about the impact this acquisition has on investors and how this could boost the market.&nbsp;<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjYwNTU1ODg4NDM2LXRlc3QyLndlYnAiLCJlZGl0cyI6eyJyZXNpemUiOnsid2lkdGgiOjk1MCwiZml0IjoiY292ZXIifX19" style="width: 300px;" class="fr-fic fr-dib">Funding a robotics venture is not easy. Between March 2020 and March 2021, robotics companies raised only 8% in capital compared to AI companies. AI-focused startups raised a total of $73.4 billion while robotics startups raised $6.3 billion. This is a paltry sum in comparison, especially when we saw an increasing need for robotics in several industries (due to COVID). &nbsp;&nbsp;<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjYwNTU1OTA4ODQxLXRlc3QzLndlYnAiLCJlZGl0cyI6eyJyZXNpemUiOnsid2lkdGgiOjk1MCwiZml0IjoiY292ZXIifX19" style="width: 300px;" class="fr-fic fr-dib">There are many reasons behind this. One of those, and the most important one, is the increased risk perception from investors. Robotics development is expensive and takes time.&nbsp;But moves like Amazon&rsquo;s show something to investors: a profitable exit. Amazon will acquire iRobot for $61 per share in an all-cash transaction valued at approximately $1.7 billion. A success story is always needed to push investment, and this certainly makes one.&nbsp;This is not an isolated event. It comes after 2 years of really interesting acquisitions. Take <a href="https://www.zebra.com/gb/en/about-zebra/newsroom/press-releases/2021/zebra-technologies-to-acquire-fetch-robotics.html" target="_blank">Zebra&#39;s acquisition of Fetch</a>, or <a href="https://www.deere.com/en/news/all-news/2021aug5-bear-flag-robotics/" target="_blank">John Deere&#39;s acquisitions of ROS-based startups</a>. Investors are aware, now more than ever, that while the risk is high, the profit/ROI could be as well. Moves like <a href="https://ubuntu.com/blog/the-state-of-robotics-september-2021" target="_blank">Amazon launching Astro</a> create more incentives.&nbsp;Amazon&rsquo;s acquisition has various implications. Only time will tell whether this boosts the market, and how much.&nbsp;<h2 dir="ltr">Robotics awareness&nbsp;</h2>Robots are now able to learn a model of their entire body from scratch, without any human assistance. <a href="https://www.science.org/doi/10.1126/scirobotics.abn1944" target="_blank">Researchers from Columbia University</a> developed a visual self-model using deep neural networks that allowed a robot to learn the relationship between its motor actions and the volume it occupied in its environment.<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjYwNTU1OTM2ODEyLXRlc3QgNC53ZWJwIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" style="width: 300px;" class="fr-fic fr-dib">The team found a way to visualise how the robot saw itself, finding a surprisingly accurate self-image. (<a href="https://www.hackster.io/news/columbia-university-researchers-gave-this-robot-arm-a-true-sense-of-self-cadeac6481a9" target="_blank">source</a>) The researchers placed a robotic arm inside a circle of five streaming video cameras. The video footage was fed to the network as the robot wiggled and contorted. This allowed it to learn exactly how its body moved in response to various motor commands.&nbsp;After about three hours, the robot learned the relationship between its motor actions and the volume it occupied in its environment. Much like an infant exploring itself for the first time in a hall of mirrors.&nbsp;<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjYwNTU1OTU2Njk5LXRlc3Q1LndlYnAiLCJlZGl0cyI6eyJyZXNpemUiOnsid2lkdGgiOjk1MCwiZml0IjoiY292ZXIifX19" style="width: 300px;" class="fr-fic fr-dib">Robot inside a circle of five streaming video cameras This awareness allows the robot to plan motion, reach goals, and avoid obstacles in a variety of situations&mdash;another small but incredible step towards robots&rsquo; self-awareness. <h2 dir="ltr">Robotics and Smart textiles</h2><a href="https://newsroom.unsw.edu.au/news/science-tech/new-shape-shifting-material-can-move-robot" target="_blank">Researchers at the University of New South Wales</a> are also working on a special project. They developed a new class of smart textiles that can shape-shift and turn two-dimensional material into 3D structures. The material is constructed from tiny soft artificial muscles. These muscles are long silicone tubes that can change shape thanks to hydraulics.&nbsp;<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjYwNTU1OTc3MTkxLXRlc3Q2LndlYnAiLCJlZGl0cyI6eyJyZXNpemUiOnsid2lkdGgiOjk1MCwiZml0IjoiY292ZXIifX19" style="width: 300px;" class="fr-fic fr-dib">The UNSW team&#39;s smart textile enables fabric reconfiguration which produces shape-morphing structures such as this butterfly and flower that can move using hydraulics. (<a href="https://newsroom.unsw.edu.au/news/science-tech/new-shape-shifting-material-can-move-robot" target="_blank">source</a>) The artificial muscles can be programmed to contract or expand into a variety of shapes depending on their initial structure. The smart textile can either be attached to existing passive material or yarn to create an active fabric.<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjYwNTU2MDAwMzM2LXRlc3QgNy53ZWJwIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" style="width: 300px;" class="fr-fic fr-dib">Structure of smart textile (<a href="https://newsroom.unsw.edu.au/news/science-tech/new-shape-shifting-material-can-move-robot" target="_blank">source</a>)&nbsp;&nbsp;<h2 dir="ltr">Spider gripper&nbsp;</h2>What&rsquo;s next is not fabric, but something from a sci-fi movie. <a href="https://news.rice.edu/news/2022/rice-engineers-get-grip-necrobotic-spiders" target="_blank">Rice University researchers</a> found a way to use dead spiders as robotic grippers. What started with a dead spider in a lab became a gripper; Necrobotics.&nbsp;<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjYwNTU2MDI3MDc0LXRlc3QgOC53ZWJwIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" style="width: 300px;" class="fr-fic fr-dib">Functioning of the spider gripper (<a href="https://www.gizmodo.com.au/2022/07/necrobotic-spiders/" target="_blank">source</a>) If you haven&#39;t noticed yet, spiders&rsquo; legs curl up when they die. This is because spiders extend their legs with hydraulic pressure and when spiders die they lose this ability. Researchers tapped into the hydraulic infrastructure of dead spiders using a needle, and by pumping air, they extended the spider&rsquo;s legs. Releasing the pressure retracted the legs, allowing them to grab objects. <h2 dir="ltr">Congratulations to ROS Industrial&nbsp;for its 10-year anniversary</h2>Happy birthday <a href="https://rosindustrial.org/" target="_blank">ROS Industrial</a>! If you don&#39;t know it yet, ROS Industrial is an open source project that seeks to extend ROS and now ROS 2 to industrial hardware and applications.&nbsp;ROS Industrial identifies and prioritises capabilities for industrial robotics and automation to address current and future application problems. They also provide a wide range of user services, including technical support and training, to facilitate the continued adoption of ROS by the industry.<iframe width="640" height="360" src="https://www.youtube.com/embed/-6yAk05et1Q?&wmode=opaque&rel=0&enablejsapi=1&origin=https://www.wevolver.com" frameborder="0" allowfullscreen="" class="fr-draggable" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true" data-gtm-yt-inspected-12="true" id="26562603" title="ROS-Industrial 10 Year Anniversary Mash Up"></iframe> They help us all carry the flag of open source in the industrial and automation domain. For that, we are truly thankful and we&rsquo;re proud to be part of this community. &nbsp;<h2 dir="ltr" id="isPasted">Robot Makers - Chapter 3 - Register now!&nbsp;</h2>Did you miss the interview with Akara Robotics CEO Conor McGinn? Don&rsquo;t worry,<a href="https://www.youtube.com/watch?v=4O3X7MM1mx8" target="_blank">&nbsp;the video is now available on youtube</a>.&nbsp;And don&#39;t miss our <a href="https://www.brighttalk.com/webcast/6793/555737?utm_source=Canonical&utm_medium=brighttalk&utm_campaign=555737?utm_source=wevolver&utm_medium=engage" rel="noopener noreferrer" target="_blank">upcoming interview with Russell Nickerson</a>, Engagement Liaison at MassRobotics. MassRobotics is a non-profit coworking space for robotics startups in Boston&#39;s Seaport, where Russell supports more than 60 residence startups.&nbsp;Based on his experience scaling robotics companies, Russell will share the dos and don&#39;ts of go-to-market strategy.&nbsp;<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjYxMTYwMTQ5MDQyLVtXZWJpbmFyXSBNYXNzUm9ib3RpY3MgUm9ib3QgTWFrZXJzIDIgKDIpLnBuZyIsImVkaXRzIjp7InJlc2l6ZSI6eyJ3aWR0aCI6OTUwLCJmaXQiOiJjb3ZlciJ9fX0=" class="fr-fic fr-dii"><ul><li dir="ltr">Register now for <a href="https://www.brighttalk.com/webcast/6793/555737?utm_source=Canonical&utm_medium=brighttalk&utm_campaign=555737?utm_source=wevolver&utm_medium=engage" rel="noopener noreferrer" target="_blank">Chapter 3 of the Robot Maker series</a></li></ul><h2 dir="ltr">Open source robotics &ndash; white papers</h2>We recently published a whitepaper about the importance of<a href="https://ubuntu.com/engage/robot-operating-system-choice?utm_source=wevolver&utm_medium=engage" rel="noopener noreferrer" target="_blank">&nbsp;choosing the right OS for your robot</a>. Picking the right OS could make a big difference in factors like security, maintenance and infrastructure for deployment.&nbsp;<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjYwNTU2MDcxNzI2LXRlc3QgOS53ZWJwIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" style="width: 300px;" class="fr-fic fr-dib"><ul><li>Review the implications and explore <a href="https://ubuntu.com/engage/robot-operating-system-choice?utm_source=wevolver&utm_medium=engage" id="isPasted" rel="noopener noreferrer" target="_blank">why so many developers chose Ubuntu</a>.&nbsp;</li></ul><h2 dir="ltr">Open source robotics &ndash; video news</h2>Another month, another video. More news, more applications, more robots! &nbsp;<iframe width="640" height="360" src="https://www.youtube.com/embed/O29XoRFNc0k?&wmode=opaque&rel=0&enablejsapi=1&origin=https://www.wevolver.com" frameborder="0" allowfullscreen="" class="fr-draggable" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true"></iframe> If you want us to feature your robotics application, just send us an email at <a data-fr-linked="true" href="mailto:robotics.community@canonical.com" rel="noopener noreferrer" target="_blank">robotics.community@canonical.com</a>.<ul><li dir="ltr">And don&#39;t forget to <a href="https://www.youtube.com/c/UbuntuOS/?sub_confirmation=1" rel="noopener noreferrer" target="_blank">follow us for more robotics news, demos and tutorials!</a>&nbsp;</li></ul><h2 dir="ltr">Open-source robotics &ndash; ROS 2 shared memory tutorial</h2>After receiving questions regarding an error message issued by ROS 2 applications in snaps, we decided to put together a blog post on this matter <a href="https://ubuntu.com/blog/how-to-use-ros-2-shared-memory-in-snaps?utm_source=wevolver&utm_medium=blog" rel="noopener noreferrer" target="_blank">&ldquo;How to use ROS 2 shared memory in snaps&rdquo;</a><img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjYwNTU2MDkzNDI3LXRlc3QgMTAud2VicCIsImVkaXRzIjp7InJlc2l6ZSI6eyJ3aWR0aCI6OTUwLCJmaXQiOiJjb3ZlciJ9fX0=" style="width: 300px;" class="fr-fic fr-dib"><a href="https://ubuntu.com/blog/how-to-use-ros-2-shared-memory-in-snaps?utm_source=wevolver&utm_medium=blog" rel="noopener noreferrer" target="_blank">In this post</a>, we review the shared memory mechanism in ROS 2, explain why the shared memory feature causes error messages in snaps and propose different solutions to tackle it.As usual, we&rsquo;d love to get your feedback. Feel free to reach out on the <a href="https://forum.snapcraft.io/" target="_blank">snapcraft forum</a>.<h2 dir="ltr">Stay tuned for more robotics news</h2>As always, we would love to hear from you. Send a summary of your robotics innovation and project to <a href="mailto:robotics.community@canonical.com" target="_blank">robotics.community@canonical.com</a>, and we will share it in our next robotics newsletter or monthly video. Thanks for reading!

Monthly robotics news blog. Discover the latest innovations, products, research, tutorials, and security news for robotics.

The State of Robotics, August 2022

In this episode, we talk about how engineers are tackling the problem of sorting through piles using robotics and a platform that leverages fake data to train robots more efficiently.<iframe height="200px" width="100%" frameborder="no" scrolling="no" seamless="" src="https://player.simplecast.com/ee270fa2-ec1d-485d-86fe-fffdf942a9f3?dark=false" class="fr-draggable" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true"></iframe><hr>This podcast is sponsored by&nbsp;<a href="https://www2.mouser.com/" id="isPasted" rel="nofollow" target="_blank">Mouser Electronics</a>. &nbsp;<img src="https://s3-us-west-1.amazonaws.com/wevolver-project-images/froala%2F1658227935701-Mouser-sponsor-1-a.jpg" style="width: 766px;" class="fr-fic fr-dib"><hr><h3 id="isPasted">EPISODE NOTES</h3>(0:57) -&nbsp;<a href="https://www.wevolver.com/article/robot-overcomes-uncertainty-to-retrieve-buried-objects" target="_blank">Robots Finding Buried Objects🤖🔑</a>(16:50) - <a href="https://www.wevolver.com/article/fake-data-helps-robots-learn-the-ropes-faster" target="_blank">Fake Data To Train Robots🤖🧠</a><hr>About the podcast:Every day, some of the most innovative universities, companies, and individual technology developers share their knowledge on Wevolver. To ensure we can also provide this knowledge for the growing group of podcast listeners, we started a collaboration with two young engineers, Daniel Scott Mitchell &amp; Farbod Moghaddam who discuss the most interesting content in this podcast series.&nbsp;To learn more about this show, please visit the <a href="https://www.wevolver.com/profile/the.next.byte" target="_blank">shows page</a>. By following the page, you will get automatic updates by email when a new show is published.Be sure to give us a follow and review on <a href="https://podcasts.apple.com/nl/podcast/the-next-byte/id1548255861?l=en" rel="nofollow" target="_blank">Apple</a> podcasts, <a href="https://open.spotify.com/show/6lPPsRtegnivsRUEsQ09R7?si=IPMiah7xT_apJtPjqvXMlA" rel="nofollow" target="_blank">Spotify</a>, and most of your favorite podcast platforms!Take a few seconds to leave us a review. It really helps! <a href="https://apple.co/2RIsbZ2" rel="nofollow" target="_blank">https://apple.co/2RIsbZ2&nbsp;</a>if you do it and send us proof, we&rsquo;ll give you a shoutout on the show.

Peter Mitrano demonstrates a rope manipulation experiment. Software that he and Berenson developed can expand training data sets for challenges like rope manipulation, doubling the success rate of the robot. Credit: Daryl Marshke, Michigan Creative, University of Michigan. 

In this episode, we talk about how engineers are tackling the problem of sorting through piles using robotics and a platform that leverages fake data to train robots more efficiently.

Podcast: Teaching Robots To Find Buried Objects

This article was discussed in our <a data-saferedirecturl="https://www.google.com/url?q=https://www.wevolver.com/profile/the.next.byte&source=gmail&ust=1657665594983000&usg=AOvVaw3qB1qyNdi7d5QIgUSYHgcz" href="https://www.wevolver.com/profile/the.next.byte" id="isPasted" rel="noopener noreferrer" target="_blank">Next Byte podcast</a>.&nbsp;<iframe height="200px" width="100%" frameborder="no" scrolling="no" seamless="" src="https://player.simplecast.com/ee270fa2-ec1d-485d-86fe-fffdf942a9f3?dark=false" class="fr-draggable" data-gtm-yt-inspected-10="true" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true"></iframe>The full article will continue below.<hr>This article was first published on <a href="https://news.mit.edu/2022/robot-pick-place-hidden-objects-0629" id="isPasted" rel="noopener noreferrer" target="_blank">MIT News</a>. &nbsp;<hr>For humans, finding a lost wallet buried under a pile of items is pretty straightforward &mdash; we simply remove things from the pile until we find the wallet. But for a robot, this task involves complex reasoning about the pile and objects in it, which presents a steep challenge.MIT researchers previously demonstrated a <a href="https://news.mit.edu/2021/robot-finds-items-camera-antenna-1005" target="_blank">robotic arm</a> that combines visual information and radio frequency (RF) signals to find hidden objects that were tagged with RFID tags (which reflect signals sent by an antenna). Building off that work, they have now developed a new system that can efficiently retrieve any object buried in a pile. As long as some items in the pile have RFID tags, the target item does not need to be tagged for the system to recover it.The algorithms behind the system, known as FuseBot, reason about the probable location and orientation of objects under the pile. Then FuseBot finds the most efficient way to remove obstructing objects and extract the target item. This reasoning enabled FuseBot to find more hidden items than a state-of-the-art robotics system, in half the time.This speed could be especially useful in an e-commerce warehouse. A robot tasked with processing returns could find items in an unsorted pile more efficiently with the FuseBot system, says senior author Fadel Adib, associate professor in the Department of Electrical Engineering and Computer Science and director of the Signal Kinetics group in the Media Lab.&ldquo;What this paper shows, for the first time, is that the mere presence of an RFID-tagged item in the environment makes it much easier for you to achieve other tasks in a more efficient manner. We were able to do this because we added multimodal reasoning to the system &mdash; FuseBot can reason about both vision and RF to understand a pile of items,&rdquo; adds Adib.Joining Adib on <a data-lf-fd-inspected-kn9eq4roawkarlvp="true" href="http://www.roboticsproceedings.org/rss18/p067.pdf" target="_blank">the paper</a> are research assistants Tara Boroushaki, who is the lead author; Laura Dodds; and Nazish Naeem. The research will be presented at the Robotics: Science and Systems conference.<iframe src="https://www.youtube.com/embed/TFqz263uPN0?&wmode=opaque&rel=0&enablejsapi=1&origin=https://www.wevolver.com" frameborder="0" allowfullscreen="" class="fr-draggable" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true" style="width: 767px; height: 437px;" data-gtm-yt-inspected-10="true" id="968592065" title="Robotic system can locate and retrieve hidden items"></iframe><h2 id="isPasted">Targeting tags</h2>A recent <a data-lf-fd-inspected-kn9eq4roawkarlvp="true" href="https://www.accenture.com/_acnmedia/PDF-155/Accenture-RFID-In-Retail.pdf" target="_blank">market report</a> indicates that more than 90 percent of U.S. retailers now use RFID tags, but the technology is not universal, leading to situations in which only some objects within piles are tagged.This problem inspired the group&rsquo;s research.With FuseBot, a robotic arm uses an attached video camera and RF antenna to retrieve an untagged target item from a mixed pile. The system scans the pile with its camera to create a 3D model of the environment. Simultaneously, it sends signals from its antenna to locate RFID tags. These radio waves can pass through most solid surfaces, so the robot can &ldquo;see&rdquo; deep into the pile. Since the target item is not tagged, FuseBot knows the item cannot be located at the exact same spot as an RFID tag.Algorithms fuse this information to update the 3D model of the environment and highlight potential locations of the target item; the robot knows its size and shape. Then the system reasons about the objects in the pile and RFID tag locations to determine which item to remove, with the goal of finding the target item with the fewest moves.It was challenging to incorporate this reasoning into the system, says Boroushaki.The robot is unsure how objects are oriented under the pile, or how a squishy item might be deformed by heavier items pressing on it. It overcomes this challenge with probabilistic reasoning, using what it knows about the size and shape of an object and its RFID tag location to model the 3D space that object is likely to occupy.As it removes items, it also uses reasoning to decide which item would be &ldquo;best&rdquo; to remove next.&ldquo;If I give a human a pile of items to search, they will most likely remove the biggest item first to see what is underneath it. What the robot does is similar, but it also incorporates RFID information to make a more informed decision. It asks, &lsquo;How much more will it understand about this pile if it removes this item from the surface?&rsquo;&rdquo; Boroushaki says.After it removes an object, the robot scans the pile again and uses new information to optimize its strategy.<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjU3Mjg2MTA2ODA1LU1JVF9GdXNlLUJvdC0wMi1QUkVTUy5qcGciLCJlZGl0cyI6eyJyZXNpemUiOnsid2lkdGgiOjk1MCwiZml0IjoiY292ZXIifX19" style="width: 766px;" class="fr-fic fr-dib">The robotic system uses radio frequency signals, computer vision, and complex reasoning to efficiently find items hidden under a pile. Image: James Day, MIT Media Lab<h2>Retrieval results</h2>This reasoning, as well as its use of RF signals, gave FuseBot an edge over a state-of-the-art system that used only vision. The team ran more than 180 experimental trials using real robotic arms and piles with household items, like office supplies, stuffed animals, and clothing. They varied the sizes of piles and number of RFID-tagged items in each pile.FuseBot extracted the target item successfully 95 percent of the time, compared to 84 percent for the other robotic system. It accomplished this using 40 percent fewer moves, and was able to locate and retrieve targeted items more than twice as fast.&ldquo;We see a big improvement in the success rate by incorporating this RF information. It was also exciting to see that we were able to match the performance of our previous system, and exceed it in scenarios where the target item didn&rsquo;t have an RFID tag,&rdquo; Dodds says.FuseBot could be applied in a variety of settings because the software that performs its complex reasoning can be implemented on any computer &mdash; it just needs to communicate with a robotic arm that has a camera and antenna, Boroushaki adds.In the near future, the researchers are planning to incorporate more complex models into FuseBot so it performs better on deformable objects. Beyond that, they are interested in exploring different manipulations, such as a robotic arm that pushes items out of the way. Future iterations of the system could also be used with a mobile robot that searches multiple piles for lost objects.&ldquo;I think that the work is very exciting in many ways and demonstrates the potential of tightly integrating some of the advances in wireless signals technologies with robotics. For example, a key observation that the paper builds upon is that unlike visible light and infrared, RF signals can go through standard materials like cardboard, wood, and plastic. The paper further capitalizes on this observation to address very difficult problems in robotics for which more conventional sensors are very limited, such as searching for objects in clutter,&rdquo; says Stephanie Gil, assistant professor of computer science at the Harvard John A. Paulson School of Engineering and Applied Sciences, who was not involved with this research. &ldquo;The paper goes further to advance the state-of-the-art of using RF signals in robotics by also considering the very difficult case of searching for untagged items in clutter. Overall, the paper showcases the great promise of integrating wireless communication technologies for sensing and perception tasks in robotics and provides for a very exciting outlook for robotics under this lens.&rdquo;<hr>&quot;Reprinted with permission of <a href="https://news.mit.edu/2022/robot-pick-place-hidden-objects-0629" id="isPasted" rel="noopener noreferrer" target="_blank">MIT News</a>&quot;&nbsp;

Fadel Adib, associate professor in the Department of Electrical Engineering and Computer Science and director of the Signal Kinetics group in the MIT Media Lab (far left) with (from left to right) Tara Boroushaki, Nazish Naeem, and Laura Dodds, research assistants in the Signal Kinetics group. Image: James Day, MIT Media Lab

This robotic system uses radio frequency signals, computer vision, and complex reasoning to efficiently find items hidden under a pile.

Robot overcomes uncertainty to retrieve buried objects

<h2 dir="ltr" id="isPasted">The State of Robotics &ndash; May &amp; June 2022</h2>In May, robotics felt the waves of the Hawksbill and Jellyfish. Last month brought us the first LTS for ROS 2, Humble Hawksbill. As part of the ROS community, we welcome this new release and congratulate everyone who made it possible.In this round-up, we will talk about ROS, drones, football and robots that eat scrambled eggs.&nbsp;Yep, enjoy ;) &nbsp;&nbsp;And don&#39;t forget that you can also share your story. We would love to feature it in our next blog. Just email us at <a href="mailto:robotics.community@canonical.com" target="_blank">robotics.community@canonical.com</a>&nbsp;<h2 dir="ltr">Security for robotics</h2><h3 dir="ltr">Critical vulnerabilities found in hospital robots</h3>Five critical bugs were <a href="https://technewsmax.com/2022/04/12/critical_vuln_hospital_robots/" target="_blank">recently found</a> in TUG autonomous mobile robots. These internet-connected robots are being used at hundreds of hospitals around the world to deliver medicine and maintenance supplies.&nbsp;<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjU2OTI4OTAxODY0LXR1Z2d5LWlubGluZS53ZWJwIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" style="width: 300px;" class="fr-fic fr-dib">The zero-day vulnerabilities (CVSS scores ranging from 7.6 to 9.8), collectively called <a href="https://www.cynerio.com/jekyllbot-5-command-center" target="_blank">JekyllBot:5</a>, required a low skill set and could be exploited without any special privileges or user interaction. When exploited, they enabled remote attacker control of the robots and access to real-time camera feeds and device data. The vulnerabilities originated in TUG Homebase Server&#39;s JavaScript and API implementation, and a WebSocket that relied on absolute trust between the server and the robots to relay commands to them. Some HTML vulnerabilities on the web portal page also allowed an attacker to insert malicious Javascript code on any computer that requested data about the robots. Cynerio, the threat research firm that discovered the bugs, immediately notified hospitals using the robot.&nbsp;&nbsp;Attacks on hospital robots could have critical consequences that impact patient care, such as disrupting or blocking drug delivery or even causing damage by crashing them into people or objects. Thankfully, none of these vulnerabilities were exploited in the wild. All five bugs have now been fixed for all TUG base server versions before version 24.<h2 dir="ltr">ROS 2 Humble, Ubuntu 22.04 and Ubuntu Core 22</h2>With the release of Ubuntu 22.04, we have a new release of ROS 2 Humble Hawksbill. This long-term support (LTS) release is the first LTS for a ROS 2 distribution. These 5 years of support show the maturity that ROS 2 has achieved. As such, it brings <a href="https://discourse.ros.org/t/ros-2-humble-hawksbill-released/25729" target="_blank">several features</a>:<ul><li dir="ltr">Type adaptation: In rclcpp, you can work with custom data structures and have them implicitly converted to be sent over the ROS network, or passed directly if you&rsquo;re using interprocess communication. This is convenient for working with complex data structures like images.</li><li dir="ltr">launch_pytest: A pytest plugin for writing tests in Python.</li><li dir="ltr">Frontend support for composable nodes: Composable nodes can now be specified in launch files.</li><li dir="ltr">Content filtered topics: Subscribers can filter which types of messages they want to see.</li></ul><img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjU2OTI4OTk1NTkyLXJvcy1odW1ibGUtaGF3a3NiaWxsLWZlYXR1cmVkLndlYnAiLCJlZGl0cyI6eyJyZXNpemUiOnsid2lkdGgiOjk1MCwiZml0IjoiY292ZXIifX19" style="width: 300px;" class="fr-fic fr-dib">And what better match for Humble Hawksbill than Jammy Jellyfish. Ubuntu 22.04 is now generally available, featuring significant leaps forward in cloud confidential computing, real-time kernel for industrial applications, and enterprise Active Directory, PCI-DSS, HIPAA, FIPS and FedRAMP compliance. This release raises the bar for open source from cloud to edge, IoT and workstations.&nbsp;For robotics development these are the most attractive features in this new distribution:<ul><li dir="ltr">Real-time kernel for Ubuntu, with the PREEMPT_RT patchset integration. This enables extreme latency-dependent use cases, providing deterministic response times to service events. Available for x86_64 and AArch64.</li><li dir="ltr">FIPS-certified Ubuntu images that make it easy for companies to fulfil different industrial compliance requirements (e.g. PCI-DSS, HIPAA and FedRAMP).</li><li dir="ltr">OVAL integration for vulnerability and patch definitions to enable auditing for Common Vulnerabilities and Exposures (CVEs)s.</li><li dir="ltr">Active Directory is now fully supported in the Ubuntu installer with Advanced Group Policy Object and allows more refined user permissions and script execution control from within Active Directory.&nbsp;</li></ul><img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjU2OTI5MDQwMzc5LXVidW50dSBqZWxseWZpc2gud2VicCIsImVkaXRzIjp7InJlc2l6ZSI6eyJ3aWR0aCI6OTUwLCJmaXQiOiJjb3ZlciJ9fX0=" style="width: 300px;" class="fr-fic fr-dib">Together with 22.04, we also released Ubuntu Core 22. Canonical announced that <a href="http://ubuntu.com/core" target="_blank">Ubuntu Core 22</a>, the fully containerised Ubuntu 22.04 LTS variant optimised for IoT and edge devices, is now generally available for download from <a href="https://ubuntu.com/download/iot" target="_blank">ubuntu.com/download/iot</a>. Combined with Canonical&rsquo;s technology offer, this release brings Ubuntu&rsquo;s comprehensive and industry-leading operating system (OS) and services to a complete range of embedded and IoT devices.For those deploying robotics devices to market, Ubuntu Core 22 brings these new features:&nbsp;<ul><li dir="ltr">It provides a path to upgrade UC20 systems to UC22 and backward compatibility of the new features to UC20.</li><li dir="ltr">Validation set that specified what applications are either required to be installed together or are permitted to be installed together on a device or system.&nbsp;</li><li dir="ltr">Quota group sets to limit services inside applications like maximum memory and CPU usage.</li></ul>To learn more about the new features on Core 22 <a href="https://ubuntu.com/blog/what-youre-missing-out-if-you-dont-try-ubuntu-core-22" target="_blank">check the next blog</a>.&nbsp;<iframe width="640" height="360" src="https://www.youtube.com/embed/6NDWqH1SrGs?&wmode=opaque&rel=0&enablejsapi=1&origin=https://www.wevolver.com" frameborder="0" allowfullscreen="" class="fr-draggable" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true"></iframe> <h2 dir="ltr">Skybrush going Open Source&nbsp;</h2>We stand behind open source projects since they make way for innovation. Just take a look at <a href="https://skybrush.io/" target="_blank">Skybrush</a>, a drone-show management platform. In early May, Skybrush announced the release of their ultimate multi-UAV mission and drone show management platform as an open-source project.&nbsp;<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjU2OTI5MDY2Mjg4LXNreWJydXNoX2xpdmVfb25fZGVza3RvcC5qcGciLCJlZGl0cyI6eyJyZXNpemUiOnsid2lkdGgiOjk1MCwiZml0IjoiY292ZXIifX19" style="width: 300px;" class="fr-fic fr-dib">Skybrush has also advanced on the drone swarm research front, with 30, 50, and up to 100 autonomous drones flying together in different cooperative scenarios. Besides putting on an impressive show, the drone orchestration platform can be used in other industries. It has practical applications for agriculture, surveillance and delivery - among other use cases.<h2 dir="ltr">Making drone nests with Wings</h2>Looking for another drone use case? Check <a href="https://wing.com/" target="_blank">Wing</a> and their drone delivery system. Wing &nbsp;is growing in Australia. The company allows small businesses to access a delivery infrastructure. Companies can ship their products through a system of different bases in the city, called wing nests. Once on the wing nest, drones can travel up to 6 miles in 6 minutes. This covers a wide range of houses. The delivery zones can expand as more wing nests get added to the network.&nbsp;<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjU2OTI5NTQxMjQ3LUZJX2hlYWRlcl8yMDQ4eDExNTEgY29weS1taW4uanBnIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" style="width: 300px;" class="fr-fic fr-dib"><h2 dir="ltr">Drones and strong winds &nbsp;</h2>To autonomously perform delivery tasks, drones need to be able to adapt to wind conditions in real-time. This is a field that is not well understood yet. <a href="https://www.caltech.edu/about/news/rapid-adaptation-of-deep-learning-teaches-drones-to-survive-any-weather" target="_blank">A team of engineers from Caltec</a>h is expanding our knowledge in this area. They developed Neural-Fly, a deep-learning method that can help drones cope with new and unknown wind conditions in real-time by incorporating pre-trained representations through deep learning. Take note, drone fans.<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjU2OTI5MTUzNTA5LUNhbHRlY2hfTmV1cmFsX0ZseV8wNi4yZTE2ZDBiYS5maWxsLTE2MDB4ODEwLWMxMDAuanBnIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" style="width: 300px;" class="fr-fic fr-dib">Neural-Fly uses an algorithm to learn the shared representation, using only 12 minutes of flight data. With the learned representation, Neural-Fly achieves precise flight control with substantially smaller tracking errors. It&rsquo;s been used to improve drone performance at wind speeds ranging up to 43.6 kilometres/hour.<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjU2OTI5MTcyODkyLUNhbHRlY2hfTmV1cmFsX0ZseV8wOC5tYXgtMTQwMHg4MDAuanBnIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" style="width: 300px;" class="fr-fic fr-dib"><h2 dir="ltr">Eating robot</h2>This news entered a new category. A food-tasting robot? Yes, a food-tasting robot. Researchers from the <a href="https://www.bbc.co.uk/news/uk-england-cambridgeshire-61313767" target="_blank">University of Cambridge&nbsp;</a>trained Beko to assess the saltiness of a dish at different stages of the chewing process, imitating a process that is similar in humans. Beko, who has already been trained to make omelettes, tasted nine variations of scrambled eggs and tomatoes at three different stages of the chewing process. The researchers attached a conductance probe to the robot&rsquo;s arm, which acts as a salinity sensor.&nbsp;<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjU2OTI5MjAzNzIwLXJvYm90IGVhdGluZyBvbWVsZXR0ZXMuanBnIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" style="width: 300px;" class="fr-fic fr-dib">Their results showed a significant improvement in robots&rsquo; ability to assess saltiness over other electronic tasting methods. In case you were wondering, the food was blended to imitate the change in texture caused by chewing.&nbsp;<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjU2OTI5NTYyNTcwLVJvYm90LWNoZWYtdHJhaW5lZC10by10YXN0ZS1mb29kLWluLWRpZmZlcmVudC1jaGV3aW5nLXBoYXNlcy5qcGciLCJlZGl0cyI6eyJyZXNpemUiOnsid2lkdGgiOjk1MCwiZml0IjoiY292ZXIifX19" style="width: 300px;" class="fr-fic fr-dib"><h2 dir="ltr">Open source robotics &ndash; white papers</h2>We recently published a <a href="https://ubuntu.com/engage/robot-operating-system-choice" rel="noopener noreferrer" target="_blank">whitepaper about the importance of choosing the right OS</a> for your robot. Picking the right OS could make a big difference in factors like security, maintenance and infrastructure for deployment. Review the implications and explore why so many developers chose Ubuntu.<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjU2OTI5NTc3MDcwLXdoaXRlcGFwZXIucG5nIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" style="width: 300px;" class="fr-fic fr-dib"><h2 dir="ltr">Open source robotics &ndash; video news</h2>Another month, another video. More news, more applications, more robots! &nbsp;<iframe width="640" height="360" src="https://www.youtube.com/embed/hvmwE6ft45A?&wmode=opaque&rel=0&enablejsapi=1&origin=https://www.wevolver.com" frameborder="0" allowfullscreen="" class="fr-draggable" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true"></iframe> If you want us to feature your robotics application, just send us an email at <a href="mailto:robotics.community@canonical.com" target="_blank">robotics.community@canonical.com</a>.<h2 dir="ltr">Open-source robotics &ndash; ROS 2 in Ubuntu with LXD tutorial</h2>Do you want to test ROS 2 Humble? If you want to test compatibility and keep your current Ubuntu (20.04, 18.04,&hellip;) environment stable until you know you are ready to upgrade, you can do that with LXD containers. <a href="https://ubuntu.com/blog/install-ros-2-humble-in-ubuntu-20-04-or-18-04-using-lxd-containers" target="_blank">Read our tutorial</a> to find out how.&nbsp;<h2 dir="ltr">Robot Makers - Chapter 2</h2>Did you miss the interview with Akara Robotics CEO Conor McGinn? Don&rsquo;t worry, the video is now available on-demand. If you want to learn about the funding landscape for robotics startups, the best sources of funding and good guidelines, this webinar is for you.&nbsp;<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjU2OTI5NjIxMzUzLVtXZWJpbmFyXSBBa2FyYSBSb2JvdCBNYWtlcnMgMiAoOCkucG5nIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" style="width: 300px;" class="fr-fic fr-dib"><h2 dir="ltr">Stay tuned for more robotics news</h2>As always, we would love to hear from you. Send a summary of your robotics innovation and project to <a href="mailto:robotics.community@canonical.com" target="_blank">robotics.community@canonical.com</a>, and we will share it in our next robotics newsletter or monthly video. Thanks for reading!

Monthly robotics news blog. Discover the latest products, research, tutorials, and security news for robotics.

The State of Robotics, May & June 2022

Swarming robots hold the potential to solve a range of real-world problems, from <a href="https://www.wevolver.com/article/dlr-measures-flow-phenomena-around-wind-turbines-with-a-swarm-of-drones" target="_blank">analyzing airflow around wind turbines</a> and <a href="https://www.wevolver.com/article/adaptive-swarm-robotics-could-revolutionize-smart-agriculture" target="_blank">improving agricultural data gathering</a> to <a href="https://www.wevolver.com/article/nasa-works-to-give-satellite-swarms-a-hive-mind" target="_blank">monitoring the weather</a> or <a href="https://www.wevolver.com/article/could.tiny.satellites.explore.space.by.flying.in.flocks" target="_blank">exploring space</a>. There&rsquo;s only one problem: Research into robotic swarms can be an expensive endeavor.That&rsquo;s the problem HeRo 2.0 aims to solve. The creation of a quartet of roboticists from Brazil, HeRo 2.0 &mdash; an upgraded, streamlined version of the earlier HeRo platform from the same team &mdash; offers a low-cost compact robotics platform for swarm research and education based on off-the-shelf components and an easily-assembled 3D-printed chassis. Better still: The whole project is open source.<h1>Miniature marvels</h1>&ldquo;The robotic platform presented in this work takes advantage of the recent technological advancements to use mass-produced components that are smaller, affordable, and long-term available,&rdquo; the team explains of the robot. &ldquo;In addition, the design and assembly process follow new trends, such as the Maker Movement and Do It Yourself, which allow others to reproduce and customize the robot using additive manufacturing.&rdquo;The team set about designing HeRo 2.0 with a view to six key design principles: The robot should be as inexpensive as possible, to allow for larger swarms to be built without great expense; each individual robot should be small yet include on-board sensing capabilities and enough power for hours of autonomous operation; it should be highly tolerant to faults; communication between robots should be scalable to a large number of individuals; the robots should be easy to assemble and use only readily-available components; and they should be easy to program using existing development frameworks.<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjQ5Mjc1NTczODU4LWhlcm8yLTIuanBnIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" style="width: 300px;" class="fr-fic fr-dib" alt="A diagram of the HeRo 2.0 robotics platform, with the following parts labelled from the top: e-Hat, PCB board, cover, rotary encoder, battery, pinion gear encoder, rubber O-ring, servo motor SG90, castor wheel, motor chassis, board chassis, motor gear, spur gear wheel.">Built using off-the-shelf components in a 3D-printed chassis, HeRo 2.0 costs just $18 yet includes all the key functionality required for basic swarm research.The final design, which first author Paulo Rezeck and colleagues say meets all six of the requirements, is certainly low cost: The full bill of materials for each unit comes out at just $18.72, including $0.10 for a 38mm rubber O-ring and a battery powerful enough to push the robot for &nbsp;three hours of active experimentation &mdash; and that&#39;s a cost which could drop in large-volume production.The bargain-basement price comes courtesy of some unusual design choices, such as turning to a low-cost rotary encoder usually used to track the movement of the scroll wheel on a computer mouse to instead track the turning of the wheels. Continuous servo motors supporting simple control via the pulse-width modulation (PWM) output of a microcontroller further reduce costs, while the 3D-printable chassis uses just a little plastic and some electricity to be produced.<iframe src="https://www.youtube.com/embed/hAS7FKYkKWQ?&wmode=opaque&rel=0" allowfullscreen="" class="fr-draggable" width="640" height="360" frameborder="0"></iframe> The microcontroller, too, was picked for its high performance at a low price: An Espressif ESP-12E, based on the ESP8266 and boasting a single 32-bit Tensilica LX106 core running at speeds of up to 160MHz plus 4MB of flash memory. To this, the team added eight infrared sensors &mdash; officially limited to measuring distances no larger than 2cm (around 0.8&quot;), but extended through clever operation to 30cm (11.8&quot;). Further expansion, meanwhile, is possible through what the team calls &ldquo;e-Hats,&rdquo; add-on modules which attach to the top of the robot to provide additional functionality &mdash; such as, the team has proven in prototype, a display screen or an inertial measurement unit (IMU).<h1>Programming perfection</h1>On the software side, the HeRo 2.0 platform offers a choice of programming paradigm. Its firmware was developed on the Arduino integrated development environment (IDE) using the Wiring language, an extended variant of C designed for embedded work. The &ldquo;rosserial&rdquo; framework was added to provide compatibility with the Robot Operating System (ROS), a popular platform for robotics work.As a result, the robots can be programmed in two ways. For direct programming, a new firmware can be written in the Arduino IDE and flashed to the robots over a Wi-Fi connection using the Firmware Over the Air (FOTA) protocol, allowing algorithms to run directly on the robots&rsquo; microcontrollers. Otherwise, the stock firmware&rsquo;s ROS support can be leveraged to place the swarm under control of a centralized server communicating via ROS messages.<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjQ5Mjc1NjM0MTQyLWhlcm8yLTQuanBnIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" style="width: 300px;" class="fr-fic fr-dib" alt="A screenshot of the RViz software showing a map generated by a HeRo 2.0 robot; its path can be seen as a continuous line surrounded by data from its on-board distance sensors.">The researchers put the robot through a range of experimental tasks, including mapping, flocking, and collaboration on an object-transportation task.&ldquo;This mode is very convenient and scalable in the early stages of testing with multiple robots,&rdquo; the team notes of the server-based ROS programming mode. &ldquo;Furthermore, using the ROS framework for implementation, we have a series of tools and may use different programming languages.&rdquo;To prove the overall performance of the platform, the team set about comparing its capabilities to the E-puck &mdash; a highly popular commercial robot which costs $975 per unit, making it an order of magnitude more expensive than the HeRo 2.0 platform albeit with additional functionality including Bluetooth connectivity, additional sensors, and an on-board camera.In all tests the HeRo 2.0 proved capable of keeping up with its commercial rival, though with one caveat: While testing functionality like flocking and cooperative transportation, the team extended the robots&rsquo; on-board sensing capabilities with an overhead camera and the Apriltag tracking algorithm &mdash; to, as the team puts it, &ldquo;emulate a sensor in the robot that captures its neighbors&rsquo; position and relative velocity&rdquo; which is lacking in the hardware as-implemented.<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjQ5Mjc1NjQ3MDQ4LWhlcm8yLTEuanBnIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" style="width: 300px;" class="fr-fic fr-dib" alt="Four photographs of a HeRo 2.0 prototype shown from the top with its circuit board and distance sensors, from underneath with its wheels and castors visible, from the front, and from the side.">The compact HeRo 2.0 shows real promise for lowering the barrier to entry for swarm research, thanks to accessible development tools and its extremely low cost. There&rsquo;s room for improvement elsewhere, too. Proposed enhancements include a migration to the newer ROS 2 platform on the software side, the development of additional e-Hat add-ons in addition to the display and IMU units already prototyped, improvements to the internal filters for localization, and investigations in how to reduce variability of the 3D-printed parts in order to reduce post-processing and thus streamline assembly. More studies are also required to see how the low-cost parts stand up to repeated use &mdash; the rotary encoders in particular requiring replacement &ldquo;after months of use.&rdquo;The team&rsquo;s work has been submitted to the journal <cite>Autonomous Robots</cite>, with a preprint available <a href="https://arxiv.org/abs/2202.12391" target="_blank">on Cornell&rsquo;s arXiv server</a>.<h1>Reference</h1>Paulo Rezeck, Hector Azpurua, Mauricio FS Correa, and Luiz Chaimowicz: <cite>HeRo 2.0: A Low-Cost Robot for Swarm Robotics Research</cite>. DOI <a href="https://arxiv.org/abs/2202.12391" target="_blank">arXiv:2202.12391</a> <a href="http://cs.RO" target="_blank"></a>[cs.RO].

Costing just $18 each, the HeRo 2.0 robot platform includes expandability via "e-Hat" add-on hardware installed on the top.

Designed using off-the-shelf parts, a low-cost microcontroller, and a 3D-printed chassis, the HeRo 2.0 robot costs just $18 to build — and is at the heart of an effort to open swarm robotics up to a broader audience.

HeRo 2.0, an ultra-low cost 3D-printed robotics platform, could open swarm robotics experimentation up to all

Challenges :- Get a production line with a diversity of steering knuckle parts - Being able to pick both semi-bulk and bulk bins - Improve the ergonomics and the environment of work for the operators - Provide a solution that is reliable, flexible and safe Solution :After 9 months of development, the production line got a full <a href="https://www.visionerf.com/services/3d-bin-picking/" rel="noopener noreferrer" target="_blank">bin-picking</a> cell, flexible and able to pick the steering knuckles from four bins inside the cell. Each bin has a fixed <a href="https://www.visionerf.com/services/cirrus-3d-2/" rel="noopener noreferrer" target="_blank">Cirrus 3D sensor</a> above it, scanning after each time the robot picks a part. The robot itself has two grippers : one is used to pick the steering knuckles, and the other one is used to suck the intermediate cardboard in the bins, everything done automatically. Outcome :- The cell allows the production to pick both left and right steering knuckles in semi-bulk or bulk and place them at the right spot - The intermediate cardboard in the middle and at the end of each bin is automatically removed - The operating cycle time is increased with less burden for operators fulfilling the tasks

Steering Knuckles Bin-Picking for Renault

Renault had a project to pick different types of steering knuckles to optimise their production. They came up with a vision solution using VISIO NERF 3D sensor and an ABB robot.

Steering Knuckles Bin-Picking

At READY we want to engage the landscape of developers outside the robotics industry to be programmers in the robotics industry. &nbsp;People who focus on user experience design, on cloud platforms, on data infrastructure, on machine learning who are playing in the app space or the SaaS business space should all be encouraged to work in the industrial space. &nbsp;There is a huge potential of amazing things in the industrial robot and manufacturing space that they could contribute to and solve hard, interesting problems right now.&nbsp;So how do they find out how they can contribute? Well frankly, it’s something that, as an industry, we’re not doing the best at. If you look at just a some Google searches, and these are in quotes, you can see how well the Android and Windows spaces enable and provide starting guidance to developers:<a href="https://www.google.com/search?q=%E2%80%9CGetting+started+with+ios+app+development%E2%80%9D" target="_blank">“Getting started with ios app development”</a> : 139,000<a href="https://www.google.com/search?q=%E2%80%9CGetting+started+with+android+app+development%E2%80%9D" target="_blank">“Getting started with android app development”</a> : 262,000<a href="https://www.google.com/search?q=%E2%80%9CGetting+started+with+window+program+development%E2%80%9D" target="_blank">“Getting started with window program development”</a> : 968,000,000<a href="https://www.google.com/search?q=%E2%80%9CGetting+started+with+mac+program+development%E2%80%9D" target="_blank">“Getting started with mac program development”</a> : 697,000,000These results are not magic. If you search for other terms like “getting started with iOS development for an iPhone”. “Getting started with Android app development”, “getting started with windows program development”, you see millions, or at least hundreds of thousands, if not millions of results for resources. If a person asks, “Hey, I’m interested in building an app for an iPhone. Where do I start?”, and they find plenty of help.The robotics industry does not have this level of support, not even close. &nbsp;Just look at these search results (as of Sept 9, 2020)!“Getting started with robot app development” : 0“Getting started with robot application development” : 0“Getting started with robot program development” : 0We’re not telling a clear message about how people outside our industry can get started and create value in robot application development or robot program development. If we broaden the search out a little more, “getting started with robotics” we at least get a few hits, but those results are mostly in the hobbyist space.&nbsp;<a href="https://www.google.com/search?q=%E2%80%9CGetting+started+with+robotics%E2%80%9D" target="_blank">“Getting started with robotics”</a> : 17,000<a href="https://www.google.com/search?q=%E2%80%9CGetting+started+with+robot+programming%E2%80%9D" target="_blank">“Getting started with robot programming”</a> : 6<a href="https://www.google.com/search?q=%E2%80%9CGetting+started+with+industrial+robots%E2%80%9D" target="_blank">“Getting started with industrial robots”</a> : 1If I’m going to build a robot with an Arduino, then I can find lots of help. That’s awesome that people have found an accessible way to get into the industry through the hobbyist market. But when we talk about real industrial systems, there is next to no accessible content or support for the general developer. Whereas in the windows app development space, I can create almost any program with the documentation that’s out there. I can create a real enterprise grade application by myself. This is a story we’ve seen where people have created very impactful applications with very little resources and it made breakout success because they could create something that was industry grade with the tools that were available.&nbsp;How do we enable these developers? &nbsp;Well, a true developer ecosystem exists when there is a clear path for those in other industries to get excited about this industry. And that’s something that, as an outsider, isn’t apparent. As a developer I’d think, “I don’t know where to start”, “I don’t know what value it is”. They either look at manufacturing and they don’t see how high tech and interesting it has become. But if they get a chance, then they get in and they’re like, “Oh, this is so fragmented. I don’t know where to start” and that is too bad. It really comes down to focusing on platforms that reduce the onboarding costs of a developer to get into our ecosystem and start producing something that is amazing.You can build one piece of software that is widely deployed. Every startup I talked to in the robotic space, one of their major sort of efforts has been, “Oh, and I had to write my program so it can interface with this robot and this robot and this robot”. &nbsp;I hear this challenge all the time. &nbsp;There’s no path for them to build one program and it just works ubiquitously on all robots and peripherals as there is in the computer industry or the mobile industry. &nbsp;Quite simply, this challenge is a turnoff for developers because they don’t want to build the same thing repeatedly. They want to focus on what their value proposition is. They want to just build the thing they want to make and start providing value immediately.So what does a thriving developer ecosystem produce? Well, it produces useful robotic solutions that end users can use without direct help. &nbsp;It produces plugins and sub platforms that other developers can use. So that’s a key piece of the mobile and other software platform spaces is that there are developers who make plugins for other developers, and innovative hardware.At READY we are building an ecosystem where developers have very easy access to the tools that let them build industrial applications. They can start solving problems, they can start to monetize those solutions. And then the end users benefit by having these amazing applications that they can use to take their robot and really get stuff done with it, which in turn enables everyone else. It also enables the plugin developers, the hardware manufacturers, who are now more excited about the vibrancy of this ecosystem. It just raises everyone up.&nbsp;

robot operating system (ROS)