<p dir="ltr" id="isPasted">The High-Temperature Carbon-Fiber 3D Printing Challenge invited engineers and designers to submit ideas on how to leverage cutting-edge materials from Mitsubishi Chemical Advanced Materials. Participants in the challenge were asked to incorporate the strength and properties of the KyronMax&reg; carbon-fiber 3D printing filament with the flexibility and sustainability of 3D printing in their design.</p><p dir="ltr">We are composing a&nbsp;series of articles featuring the finalists and winners of the challenge.</p><p dir="ltr">In this article we showcase the work of <a href="https://www.linkedin.com/in/robinkocher/" target="_blank">Robin Kocher</a> from Human Earth Industries an upcoming player in the micro-engineered suits domain.</p><h2 dir="ltr">Suits for the future</h2><p dir="ltr">The specialized suits designed by Kocher, aims to protect against harsh weather conditions. The suits are primarily intended for providing support during disaster relief, extreme sports, and various outdoor activities. They have multiple layers which can be customized based on the activity.</p><p dir="ltr">&quot;We visualize the company in two parts. The primary focus behind Human Earth Industries is facilitating a change in society, imparting a sense of awareness in people regarding the 17 sustainable development goals, and spreading the word of change. The second part is the engineering aspect of it, where we aim to revolutionize the fashion technology industry,&quot; said Kocher. The idea for developing the suits was first conceptualized when Robin was still a student. As a gaming enthusiast, he wondered how the advanced suits in video games would be like in the real world. &quot;My interest in video games and science fiction helped me design the fabrics for the prototype. The ideas stemmed mainly from publicly available research,&quot; he added. &nbsp;</p><p dir="ltr"><span class="fr-img-caption fr-fic fr-dib" style="width: 302px;"><span class="fr-img-wrap"><img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjY5NTc0MzQxNDM4LWltYWdlMS5wbmciLCJlZGl0cyI6eyJyZXNpemUiOnsid2lkdGgiOjk1MCwiZml0IjoiY292ZXIifX19" style="width: 300px;" class="fr-fic fr-dib"><span class="fr-inner">The suit imagined by Human Earth Industries. Image credit: Human Earth Industries</span></span></span></p><h2 dir="ltr" id="isPasted">Sustainability is the top priority</h2><p dir="ltr">The suit has a customizable design where one can alter various functionalities. It would be possible to insert a layer that can measure the heart rate, blood oxygen, and ambient conditions. Additionally, another layer with a pathfinder module and smart ventilation (heating and cooling), primarily geared towards disaster relief activities would also be incorporated. &quot;The material that we use for the suits are not particularly environmentally friendly. I want to make products that can be used for a long time and the suits are designed to last a lifetime. I want people to pass on the suits to the next generations. This is one of my approaches to sustainability. The components would be made from bio-compostable products in the future,&quot; said Kocher.</p><h2 dir="ltr">Diversifying functionalities with carbon-fiber</h2><p dir="ltr">The early-stage startup wants to engineer their specialized suits for various operations. For instance, Robin has deep-dived into the topic and has identified the risks involved for horseback riders.</p><p dir="ltr">He is developing a prototype of a safety vest with a carbon fiber layer that protects the riders from potentially severe falls. This vest can also be purposed for other activities such as skiing and motorbiking.</p><p dir="ltr"><img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjY5NTc0MzkzODMxLWltYWdlMi5wbmciLCJlZGl0cyI6eyJyZXNpemUiOnsid2lkdGgiOjk1MCwiZml0IjoiY292ZXIifX19" style="width: 300px;" class="fr-fic fr-dib"></p><h2 dir="ltr" id="isPasted">MCAM&rsquo;s Growth Garage challenge pushed design ideation</h2><p dir="ltr">When we asked Robin, what the most challenging criteria of the submission was, he said: &quot;The criteria pertaining to the technical requirements was quite impressive, especially when we had to work with high-temperature requirements. When we started designing the product, we had to make sure that it satisfied the sustainability as well the high temperature criterion. It helped me visualize the incorporation of the carbon fiber layer in the specialized suits. The challenge was quite an enjoyable experience for me.&quot;</p><p dir="ltr">Kocher is impressed by Mitsubishi Chemical&rsquo;s focus on sustainability and conscientious practices. It was also one of the reasons that compelled him to enter the challenge. &quot;As a self-financed startup, it is always nice to receive support from organizations that can help us take our product to the next level, in terms of design, manufacturing and product upgrades. I would love to take part in the new challenges and create an awareness of thriving in the industry by consciously contributing back to the environment and society,&quot; he said.</p><p dir="ltr">Follow <a href="https://www.linkedin.com/showcase/growth-garage-mcam/" target="_blank">Growth Garage</a>&#39;s&nbsp;LinkedIn page for more interesting stories about 3D printing entrepreneurs in various fields.</p><h2 id="isPasted"><strong>The Composite Engineering Challenge</strong></h2><p>We are inviting innovators, entrepreneurs, and early adopters at universities, (pre-) startups, and scaleups that need <strong>fiber-reinforced composites</strong> to realize their prototype, part, product, or application.&nbsp;</p><p>We welcome projects, programs, and companies in the field of new mobility (EV, e-motor, battery casing, etc.), autonomous (delivery) vehicles, people movers, robotics, aerospace, space, bicycles, UAV, AAV, bionics (wheelchairs, exoskeletons, prosthetics), alternative energy (production, storage, transport), self-sensing or self-healing, sport &amp; leisure, alternative (low carbon footprint) fibers and more!</p><p><strong>The winning entry will be rewarded with a partnership with Growth Garage,&nbsp;</strong><strong>Business Incubator of the MCG Advanced Materials Division</strong><strong>.&nbsp;</strong></p><p><strong>This partnership package is valued at $25,000 and will be tailored to the winning team&rsquo;s needs according to their current business and product development stage.&nbsp;</strong></p><p><a class="button-main-action" href="https://wevlv.co/homepage-banner" rel="nofollow" target="_blank">READ MORE ABOUT THE CHALLENGE HERE.</a></p><table cellpadding="0" cellspacing="0"><tbody><tr><td valign="top"><h2><strong>Key Dates</strong></h2><table><tbody><tr><td><strong>Composite Challenge Launch</strong>&nbsp;</td><td>Monday, October 24th, 2022</td></tr><tr><td><strong>Challenge Close</strong>&nbsp;</td><td>Sunday 22 January 2023&nbsp;<br></td></tr><tr><td><strong>Finalists Announced</strong>&nbsp;</td><td>Wednesday 1 February 2023&nbsp;<br></td></tr><tr><td><strong>Wevolver Community Vote</strong>&nbsp;</td><td>From 1-12 February 2023&nbsp;<br></td></tr><tr><td><strong>Winners announcement</strong>&nbsp;</td><td>Tuesday 21 February 2023&nbsp;</td></tr></tbody></table></td></tr></tbody></table><p><img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjY5NTc0NDUyMDMzLWV5SmlkV05yWlhRaU9pSjNaWFp2YkhabGNpMXdjbTlxWldOMExXbHRZV2RsY3lJc0ltdGxlU0k2SW1aeWIyRnNZUzh4TmpZMk5UazRNakEyTlRnMExVMURSeUJzYjJkdklHSmhibTVsY2k1cWNHY2lMQ0psWkdsMGN5STZleUp5WlhOcGVtVWlPbnNpZDJsa2RHZ2lPamsxTUN3aVptbDBJam9pWTI5MlpYSWlmWDE5LndlYnAiLCJlZGl0cyI6eyJyZXNpemUiOnsid2lkdGgiOjk1MCwiZml0IjoiY292ZXIifX19" style="width: 300px;" class="fr-fic fr-dib"></p><p><br></p>

Carbon fiber fashion aims to assist humans to endure extreme weather and activities. 


Augmenting human endurance with carbon fiber suits

<p dir="ltr" id="isPasted">The advancements in computer vision, pattern recognition and signal processing have made visual speech recognition possible for a variety of applications, such as human-computer interaction, speaker recognition, talking heads, sign language recognition and video surveillance. Visual speech recognition deals with several technological breakthroughs, like image processing, artificial intelligence, object detection, and statistical modeling only uses visual signals of the lip movement that produce speech without relying on the audio [1]. In the first generation of VSR, the research could not meet the high accuracy demands of the industry due to factors concerning the size of the audio-visual dataset with limited vocabulary and hand-crafted visual features that are not optimal for VSR model training. &nbsp;</p><p dir="ltr">The introduction of deep learning and neural networks has made visual speech recognition models more robust than ever before while achieving higher accuracy in unstructured real-life situations. Most recent innovations allow the models to perform much better due to the availability of larger datasets and training models with a huge amount of data. A group of researchers affiliated with the Department of Computing at Imperial College London and Meta AI proposed a novel approach to add prediction-based auxiliary tasks to the VSR model and outperform state-of-the-art methods trained on the publicly available data [2].</p><h2 dir="ltr">Looking to Listen</h2><p dir="ltr">In the research paper, “Visual Speech Recognition for Multiple Languages in the Wild,” the team carried out work with the aim to reduce the word error rate (WER) through appropriate data augmentation and hyperparameter optimization of the existing architecture while working on the publicly available datasets that are much smaller in size. Through this, the team points out the fact that the optimization of the models can be brought in through carefully designing the models and not only increasing the size of the training data. Also, the proposed novel method for visual speech recognition not only evaluates English as a sole language but also on Mandarin, Spanish, Italian, French and Portuguese and achieves state-of-the-art performance on all the languages.&nbsp;</p><p dir="ltr">“We optimize hyperparameters and improve the language model with the aim of squeezing extra performance out of the model,” the team explains. Then, “we introduce time-masking which is a temporal augmentation method and is commonly used in ASR models. Finally, we use a VSR model with auxiliary tasks where the model jointly performs visual speech recognition and prediction of audio and visual representations extracted from pre-trained VSR and ASR models.”</p><p dir="ltr"><span class="fr-img-caption fr-fic fr-dib" style="width: 766px;"><span class="fr-img-wrap"><img src="https://s3-us-west-1.amazonaws.com/wevolver-project-images/froala%2F1647384806878-Visual+Speech+Recognition+Results+on+the+LSR2+Dataset.png" style="width: 800px;" class="fr-fic fr-dib" alt="Visual Speech Recognition Results on the LSR2 Dataset"><span class="fr-inner" spellcheck="false">Visual Speech Recognition Results on the LSR2 Dataset [Image Source: Research Paper]</span></span></span></p><div style='pointer-events: none; overflow: hidden; padding-bottom: 2px; z-index: auto; position: absolute; left: 0px; top: 374.688px; height: 39px; width: 766px; font-style: normal; font-variant: normal; font-weight: 400; font-stretch: 100%; font-size: 14px; font-family: "PT Serif", serif; text-align: center; text-transform: none; letter-spacing: normal; word-spacing: 0px; tab-size: 8;'><br></div><p>Hyperparameter optimization aims to improve the performance of the model by adjusting the values of the parameters that are employed to control the training process and the model architecture. There are several hyperparameters taken into consideration including initial learning rate, learning rate decay parameter, number of layers, size of layers, dropout rate, and the loss function that was performed on the LRS2 dataset achieving reduction in WER on the validation set. The main hyperparameter that had a significant impact on the performance and which might not have been exhaustively optimized was the batch size. The team observed that reduction WER was achieved more when the batch size increased from 8 to 16. Due to GPU memory constraints, the team recognized that certain hyperparameters could not be increased further, but they would bring down the word error rate.&nbsp;</p><h2 dir="ltr">State-of-the-art performance</h2><p dir="ltr">The team decided to use all the open-source datasets available for public use, namely LRS2 (an audio-visual English dataset from BBC programs), LRS3 (an audio-visual English dataset taken from TED and TEDx talks), CMLR (a Mandarin dataset collected from Chinese news program), CMU-MOSEAS (contains multiple languages from YouTube videos), Multilingual TEDx (multilingual corpus taken from TEDx talks), and AVSpeech (dataset with over 4700 hours of video in multiple languages). To measure performance, the word error rate is a common performance metric in speech recognition, with an alternative of a character error rate that measures how close the predicted and target character sequences are.&nbsp;</p><p dir="ltr">For the multilingual TEDxSpanish dataset, the approach results in a 5.6% absolute reduction in the WER and a further reduction of 4.2% can be achieved by using additional training data. While for the Italian corpus, the approach results in an absolute drop of 5.6% in the WER, the same as that for Spanish, but a further reduction of up to 8% for additional training data. “Results on the Multilingual TEDxFrench dataset are shown as a result of a 9.4 % absolute reduction in the WER and a further reduction of 7.6 % can be achieved by using additional training data.” [More details on the additional training data are available in the research article]</p><p dir="ltr"><span class="fr-video fr-deletable fr-fvc fr-dvb fr-draggable" contenteditable="false" draggable="true"><iframe width="640" height="360" src="https://www.youtube.com/embed/FIau-6JA9Po?&amp;wmode=opaque&amp;rel=0&amp;enablejsapi=1&amp;origin=https://www.wevolver.com" frameborder="0" allowfullscreen="" class="fr-draggable" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true"></iframe></span>The proposed novel method for visual speech recognition performs visual speech recognition and prediction of audio and visual representation on a publicly available dataset to outperform state-of-the-art methods. The research work was published on Cornell University’s research sharing platform, arXiv under <a href="https://arxiv.org/abs/2202.13084" target="_blank">open access terms</a>. The researchers have provided pre-trained networks and testing code on the authors’ <a href="https://github.com/mpc001/Visual_Speech_Recognition_for_Multiple_Languages" target="_blank">GitHub repository</a> for community access.</p><h2 dir="ltr">References</h2><p dir="ltr">[1] Ahmad B. A. Hassanat: Visual Speech Recognition. DOI arXiv: <a href="https://arxiv.org/abs/1409.1411" target="_blank">1409.1411 [cs.CV]</a>.</p><p dir="ltr" id="isPasted">[2] Pingchuan Ma, Stavros Petridis, Maja Pantic: Visual Speech Recognition for Multiple Languages in the Wild. DOI arXiv: <a href="https://arxiv.org/abs/2202.13084" target="_blank">2202.13084 [cs.CV]</a>.&nbsp;</p>

Visual Speech Recognition on a Multilingual Dataset that outperforms the state-of-the-art methods [Image Source: Research Paper]

A novel approach to visual speech recognition that carefully designs the VSR model rather than increasing the size of the training data.


Research suggests improvements in visual speech recognition on a multilingual dataset

<p id="isPasted"><a href="https://brooksrehab.org/" target="_blank">Brooks Rehabilitation</a> recently announced that the MagTrack study, a collaborative research endeavor with the&nbsp;<a href="https://www.ece.gatech.edu/" target="_blank">Georgia Tech School of Electrical and Computer Engineering</a>, has been successfully completed. Feedback from the Brooks clinical team and its patients has allowed Georgia Tech engineers to transform their early research prototype into a user-ready version that was tested by more than 17 power wheelchair users living with tetraplegia — a form of paralysis caused by spinal cord injury that affects the arms, hands, trunk, legs, and pelvic organs.</p><p>The collaboration between the Brooks and Georgia Tech teams has created a path to a first-of-its-kind, innovative application for individuals living with disabilities. The teams — comprised of physicians, clinical therapists, and engineers — brought together multidisciplinary expertise in advanced science, technology, and clinical rehabilitation.</p><p>“We met with the Georgia Tech team years ago, when we first heard of the research breakthroughs they were achieving for wheelchair users. Brooks is constantly looking for technology that is useful for our patient population living with spinal cord injuries and mobility impairments. To see where the MagTrack project has advanced even just since the early stages of this study is incredible,” said Geneva Tonuzi, medical director of the spinal cord injury program, the spinal cord injury and related disorders day treatment program, and Cyberdyne HAL Therapy at Brooks Rehabilitation.</p><p>As a result of this engineering-clinical collaboration,&nbsp;<a href="https://magtrack.ece.gatech.edu/" target="_blank">MagTrack</a> was created as a cutting-edge assistive technology that enables power wheelchair users to control their connected devices (e.g., smartphone, computer) and drive their power wheelchairs using an alternative, multimodal controller. In addition, the assistive device is designed to be wearable, wireless, and adaptable to the user’s specific condition.</p><p>The MagTrack study is earning the praise of patients and scientists alike and has been&nbsp;<a href="https://ieeexplore.ieee.org/document/9540352" target="_blank">published</a> in&nbsp;<a href="https://www.embs.org/tbme/" target="_blank"><em>IEEE Transactions on Biomedical Engineering</em></a>. From the beginning, the MagTrack studies have tested the performance of the Head-Tongue Controller (HTC), an earlier version of the MagTrack technology, on its ability to perform complex human-machine interactions that will enhance users’ quality of life. The MagTrack’s HTC allows the user to perform a variety of complex tasks in a single controller through the use of tongue and head movements, which are detected by eyewear and a tiny tracer that is temporarily glued onto the tongue using Glustitch’s&nbsp;<a href="https://periacryl.com/" target="_blank">PeryAcryl</a> bio-compatible adhesive. Target-specific commands are generated from these motions using advanced data processing and machine learning models. This combination of input modalities allows the user to perform a variety of daily functions with customizable control, from performing complex computer tasks (e.g., mouse navigation, scrolling, drag-and-drop) to completing advanced driving maneuvers when connected to a power wheelchair.</p><p>In the latest study, researchers connected the MagTrack technology to a single power wheelchair donated by Quantum Rehab, and recruited 17 patient volunteers from Brooks Rehabilitation to test the functionality and usability of the device by completing a set of both simple and advanced driving tasks. Results showed that new users of MagTrack can complete these tasks as fast, and sometimes even faster, with the MagTrack’s HTC rather than their personal, alternative controller. Since the study session lasted less than 3 hours — and in a power wheelchair that wasn’t their own — it is anticipated that participants would be more proficient, and thus perform better with MagTrack, if they were given more time to familiarize themselves with its multimodal capabilities and using their own power wheelchair.</p><p>"Working with all of the participants has been very rewarding,” said Jesse Milliken, speech-language pathologist in the spinal cord injury program at&nbsp;<a href="https://brooksrehab.org/" target="_blank">Brooks Rehabilitation Hospital</a>. “Each patient who came in was someone who has been directly affected by a spinal cord injury and who can truly benefit from this technology. It was amazing to see how their faces lit up when they saw they were able to control their wheelchair with such ease and comfort. They all said they can see this improving their day-to-day lives if it were available to them. It's been such an honor to be a part of this process and see the work and thought process behind such advanced technology." Patients from the&nbsp;<a href="https://brooksrehab.org/" target="_blank">Brooks</a> spinal cord injury program who have participated in phase three of the study call the advancement “exciting” and a “great system that can be used for so many things.” After experiencing the technology themselves, they believe it will “touch the lives of those who are able to use it.”</p><p>To date, the head array and sip-and-puff are the most common alternative controllers recommended by physical therapists to individuals living with tetraplegia, while specialized switches and joystick technology are available for those with mobility in their upper extremities. These technologies were developed many decades ago for the basic need of controlling a power wheelchair. Since then, a lack of innovation in this field has hindered these assistive technologies from adapting to today’s technology. Furthermore, they are affixed to the wheelchair, which becomes inaccessible once the user is transferred to a bed, a couch, or any location away from the wheelchair. Therefore, there is a growing need for this population to have access to new, alternative controllers that will enable them to be active members of an interconnected digital world.</p><p>“The trajectory of the MagTrack study shows an unprecedented possibility for the advancement of independent function as well as mobility for electric wheelchair users. Our team and partners are energized and motivated by the recent patient trials to continue to push this technology and its capabilities as far as possible. This technology can significantly improve people’s lives. We will continue to work to see these advances in assistive technology come to life,” said Georgia Tech’s Omer T. Inan, director of the Inan Research Lab, Linda J. and Mark C. Smith Chair in Bioscience and Bioengineering, associate professor in the School of Electrical and Computer Engineering, and adjunct associate professor in the Wallace H. Coulter Department of Biomedical Engineering.</p><p>“MagTrack is an innovative assistive technology aimed for those living with physical paralysis to have access to more complex human-machine interactions, which will facilitate the control of more devices in their everyday life that they cannot easily use otherwise,” said Nordine Sebkhi, postdoctoral researcher at the Inan Research Lab in the School of Electrical and Computer Engineering. “The development of our wearable alternative controller eliminates the need for having multiple assistive technologies, replacing them with a single multimodal and integrated system.” Sebkhi is the co-creator of MagTrack and the technical lead in the development of this assistive technology.</p><p>As a result of these studies,&nbsp;<a href="https://magtrack.ece.gatech.edu/" target="_blank">MagTrack</a> has been refined to offer a fully integrated, all-in-one experience so that a user can seamlessly switch between driving their wheelchair and controlling connected devices in their surroundings (e.g., smartphone, computer, automated door opener, smart TV). The system can be used anywhere since it is wearable, and its built-in wireless connectivity facilitates portability.</p><p>The team at Georgia Tech is already working on a new version of&nbsp;<a href="https://magtrack.ece.gatech.edu/" target="_blank">MagTrack</a> that is not only more inconspicuous, but also includes detection of facial gestures that significantly augments its control capabilities. Thanks to a grant from the&nbsp;<a href="https://gra.org/" target="_blank">Georgia Research Alliance</a>, this new version of MagTrack will be tested in a focus group at the&nbsp;<a href="https://www.shepherd.org/" target="_blank">Shepherd Center</a> and in simulated testing in a home-like environment. In the coming year, the team plans to make MagTrack available to early adopters for at-home validation testing to further improve the technology before pursuing commercialization.</p><p>This successful study is only a start since, at its core, MagTrack is a new type of body motion tracking. The Georgia Tech team is working on various designs of MagTrack to be used as a wearable articulograph for motor speech disorders, as a hand and joint tracking system for physical rehabilitation, and even as a finger tracking for VR/AR applications. The MagTrack team will be partnering with the&nbsp;<a href="https://gcmiatl.com/" target="_blank">Global Center for Medical Innovation</a> to assist in regulatory strategy and project planning to transition the technology from the lab to the market.</p>

A squint is an example of a facial gesture that MagTrack can detect and issue a discrete command to control a connected device.

Clinical work begins with MagTrack, a cutting-edge assistive technology that enables power wheelchair users to control their connected devices and drive their power wheelchairs using an alternative, multimodal controller.

MagTrack Technology Opens Doors for Independent Operation of Smartphones, Computers, and Other Devices for Wheelchair Users

<p dir="ltr" id="isPasted">Training robots to learn new skills has been a complex process restricting the work for programmers and roboticists. Scientists who study human-robot interaction often focus on easing the robot training process for it to learn new tasks in an unstructured environment. Today, most of the techniques for teaching robots are limited to the use of remote hardware or imitating pre-recorded demonstrations. The idea of teaching robots through a self-learning mechanism by watching humans do the task— allows the deployment of these robots in a new setting. As fancy as it sounds, there are certain challenges faced by the vision-based learning process as there exists a clear embodiment gap between the human demonstrator and the robotic hardware that executes the task.&nbsp;</p><p dir="ltr">As reported by the existing research [1,2], even though humans and robots are capable of performing the same task, the differences in the physique can make easy tasks complex or even impossible to do. A team of researchers from Stanford University, Robotics at Google and the University of California at Berkeley collaborated to apply well-established reporting of human-robot interaction to focus on teaching robots from third-person observations of demonstrations [3]. The researchers identified the opportunity to investigate the scope of self-supervised methods for vision-based learning techniques while considering the differences in human-robot embodiments, like shape, action and end-effector dynamics.&nbsp;</p><h2 dir="ltr">Robots See, Robots Do</h2><p dir="ltr">In the paper, “XIRL: Cross-embodiment Inverse Reinforcement Learning,” the researchers carried out work to solve the challenges of embodiment through self-supervised mechanisms of high-level task objectives from videos. Rather than focusing on the way humans perform tasks and relating it to robot training, the proposition summarizes the knowledge in the form of a reward function that is invariant to the embodiment differences. This means it is now possible to learn vision-based reward functions from cross-embodiment demonstration videos that are robust to the differences mentioned earlier.&nbsp;</p><p dir="ltr"><span class="fr-img-caption fr-fic fr-dib" style="width: 766px;"><span class="fr-img-wrap"><img src="https://s3-us-west-1.amazonaws.com/wevolver-project-images/froala%2F1646257426964-Cross-Embodiment+Inverse+Reinforcement+Learning.gif" style="width: 800px;" class="fr-fic fr-dib" alt="Cross-Embodiment Inverse Reinforcement Learning"><span class="fr-inner" spellcheck="false">XIRL self-supervises reward functions using temporal cycle consistency (TCC), then uses them for reinforcement learning to learn new skills from third-person demonstrations [Image Source: Research Paper]</span></span></span></p><div style='pointer-events: none; overflow: hidden; padding-bottom: 2px; z-index: auto; position: absolute; left: 0px; top: 429.75px; height: 63px; width: 766px; font-style: normal; font-variant: normal; font-weight: 400; font-stretch: 100%; font-size: 14px; font-family: "PT Serif", serif; text-align: center; text-transform: none; letter-spacing: normal; word-spacing: 0px; tab-size: 8;'><br></div><p>“The learned rewards can be used together with reinforcement learning (RL) to teach the task to agents with new physical embodiments through trial and error,” the team explains in a <a href="https://ai.googleblog.com/2022/02/robot-see-robot-do.html" rel="noopener noreferrer" target="_blank">Google AI blog post</a>. “Our approach is general and scales autonomously with data — the more embodiment diversity presented in the videos, the more invariant and robust the reward functions become.”</p><p dir="ltr">Even in the presence of embodiment differences, there still exist visual cues that indicate the task objective. The fundamental idea behind the XIRL is to discover the key moments in the videos of different lengths and clusters to encode task progression. The work carried out in XIRL leverages the Temporal Cycle Consistency (TCC) [4] that aligns the video accurately while learning the visual cues for understanding the task objective without requiring any ground-truth correspondences. The reward function in the learning process is the negative Euclidean distance between the current observation and the goal observation in the learned embedding space. This reward function is then fed into a standard Markov decision process and uses a reinforcement learning algorithm to learn the third-person demonstrated behavior.&nbsp;</p><h2 dir="ltr">Transfer policies from humans to robots in simulation</h2><p dir="ltr">Along with the cross-embodiment inverse reinforcement learning label-free framework, the team proposes a cross-embodiment imitation learning benchmark, X-MAGICAL that features several tried agents with different embodiments performing the same defined task including one thousand expert demonstrations for a single agent. “The goal of X-MAGICAL is to test how well imitation or reward learning techniques can adapt to systematic embodiment gaps between the demonstrator and the learner,” the team notes. “These differences in execution speeds and state-action trajectories pose challenges for current LfD techniques, and the ability to generalize across embodiments is precisely what this benchmark evaluates.</p><p dir="ltr"><span class="fr-img-caption fr-fic fr-dib" style="width: 766px;"><span class="fr-img-wrap"><img src="https://s3-us-west-1.amazonaws.com/wevolver-project-images/froala%2F1646257571549-Comparison+of+XIRL+with+baselines+using+the+simulated+State+Pusher+environment.png" style="width: 800px;" class="fr-fic fr-dib" alt="Comparison of XIRL with baselines using the simulated State Pusher environment"><span class="fr-inner" spellcheck="false">Comparison of XIRL with baselines using the simulated State Pusher environment [Image Source: Research Paper]</span></span></span></p><div style='pointer-events: none; overflow: hidden; padding-bottom: 2px; z-index: auto; position: absolute; left: 0px; top: 477.5px; height: 39px; width: 766px; font-style: normal; font-variant: normal; font-weight: 400; font-stretch: 100%; font-size: 14px; font-family: "PT Serif", serif; text-align: center; text-transform: none; letter-spacing: normal; word-spacing: 0px; tab-size: 8;'><br></div><p>The results show that the XIRL significantly outperforms the alternative methods on both the X-MAGICAL benchmarks and the human-to-robot transfer benchmark. The team demonstrates the effectiveness of the proposed methodology by using third-person demonstrations on the State Pusher [5] setting where the reward function is first learned on real-world human demonstration and then used to teach a Sawyer arm to perform the task in simulation. The XIRL methodology trained on real-world demonstration (purple) reaches 80% of the total performance around 85% faster than the reinforcement learning with videos (RLV) as baseline (orange).</p><h2 dir="ltr">Conclusion on XIRL be used for learning RL policies</h2><p dir="ltr">In the proposed approach to tackle the cross-embodiment imitation problems, the XIRL learns an embodiment invariant reward function technique using a temporal cycle consistency objective. Compared to baseline alternatives, XIRL reward functions are significantly more efficient. While the experimental results are quite promising, the team plans to show policy learning on a real robot post-COVID pandemic.&nbsp;</p><p dir="ltr">This research article was published on Cornell University’s research sharing platform, arXiv under <a href="https://arxiv.org/pdf/2106.03911.pdf" rel="noopener noreferrer" target="_blank">open access terms</a>.</p><h2 dir="ltr">References</h2><p dir="ltr">[1] Abhishek Gupta, Coline Devin, YuXuan Liu, Pieter Abbeel, Sergey Levine: <em>Learning Invariant Feature Spaces to Transfer Skills with Reinforcement Learning</em>. DOI <a href="https://arxiv.org/abs/1703.02949" target="_blank">arXiv:1703.02949 [cs.AI]</a>.</p><p dir="ltr">[2] Pierre Sermanet, Corey Lynch, Yevgen Chebotar, Jasmine Hsu, Eric Jang, Stefan Schaal, Sergey Levine: <em>Time-Contrastive Networks: Self-Supervised Learning from Video</em>. DOI <a href="https://arxiv.org/abs/1704.06888v3" target="_blank">arXiv:1704.06888 [cs.CV]</a>.</p><p dir="ltr">[3] Kevin Zakka, Andy Zeng, Pete Florence, Jonathan Tompson, Jeannette Bohg, Debidatta Dwibedi: <em>XIRL: Cross-embodiment Inverse Reinforcement Learning</em>. DOI <a href="https://arxiv.org/abs/2106.03911" target="_blank">arXiv:2106.03911 [cs.RO]</a>.</p><p dir="ltr">[4] D. Dwibedi, Y. Aytar, J. Tompson, P. Sermanet, and A. Zisserman. Temporal cycle-consistency learning. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2019.</p><p dir="ltr">[5] K. Schmeckpeper, O. Rybkin, K. Daniilidis, S. Levine, and C. Finn. Reinforcement learning with videos: Combining offline observations with interaction, 2020</p>

Real-world-demo cross-embodiment setting [Image Source: Research Paper]

Human-robot interaction focuses on teaching robots from third-person observations of demonstrations to make it invariant and robust to the embodiment differences.

Vision-based learning technique for robots during training

<p id="isPasted">Voice control has emerged as one of the most popular approaches for hands-free interaction with technology, from dictating short messages to a smartphone to telling a home assistant system to turn the heating up. It has one big drawback, however: The fact you have to voice your intentions aloud, which brings with it privacy and etiquette issues for public use.</p><p>SpeeChin, a necklace-style wearable developed at Cornell University with colleagues from McGill and Zhejiang Universities, aims to solve that problem — by ensuring you never have to utter a single word out loud, using silent speech recognition (SSR) derived from infrared camera footage.</p><h1>Why a necklace?</h1><p>“There are two questions: First, why a necklace? And second, why silent speech,” corresponding author Chen Zhang, assistant professor at Cornell, says of the project. "We feel a necklace is a form factor that people are used to, as opposed to ear-mounted devices, which may not be as comfortable.</p><p>“As far as silent speech, people may think, ‘I already have a speech recognition device on my phone.’ But you need to vocalize sound for those, and that may not always be socially appropriate, or the person may not be able to vocalize speech.”</p><p>Silent speech recognition systems which track facial movements associated with speech without the need for the user to make any actual noise — simply mouthing the word is enough. Existing systems have typically relied on a front-facing camera or sensors fitted to the head, face, or even inside the mouth, none of which are particularly well-suited to frequent use.</p><p><span class="fr-video fr-deletable fr-fvc fr-dvb fr-draggable" contenteditable="false" draggable="true"><iframe src="https://www.youtube.com/embed/pDf86dSPYYI?&amp;wmode=opaque&amp;rel=0" allowfullscreen="" class="fr-draggable" width="640" height="360" frameborder="0"></iframe></span><br>SpeeChin, by contrast, uses a single infrared camera module plus infrared LEDs for lighting — and points it up at the user’s chin from a 3D-printed necklace worn on a small silver chain around the neck. The images thus captured are processed, then fed through a deep-learning system which uses changes in the shape of the user’s neck and face to determine which of a series of pre-set command words are being silently uttered.</p><p>“We first tried using a standard RGB [visible light] camera,” the team explains of its prototypes. “However, we found it difficult to segment the user’s head from different backgrounds. We considered using a thermal camera or depth camera [but these] are too large to be considered ‘minimally obtrusive’ or the image resolution is too low. We settled on an IR camera due to its convenient filter system for background segmentation, small size, and relatively high image resolution.”</p><p>Using an infrared camera system brings an additional advantage, too: Fitted with filters operating at 650nm and 850nm, the device is unable to capture background details easily — addressing a big privacy issue with previous camera-based silent speech recognition implementations.</p><h1>Learning the words</h1><p>Images from the necklace camera, which is connected to a low-cost off-the-shelf Raspberry Pi single-board computer, are pre-processed to remove noise caused by changes in the device’s angle and positioning — minimized through the use of a weighted base and a free-sliding chain — and from clothes or lights entering the frame.</p><p>Once processed, the images are split up based on an utterance detection algorithm, designed to cut actual utterances out of general movement, and then fed into the SpeechNet end-to-end deep learning model. Based on a combination of both convolutional and recurrent neural network (CNN and RNN) technologies, the complete chain includes a global average pooling step and a long short-term memory (LSTM) block plus a final linear layer which outputs the detected speech command.</p><p><span class="fr-img-caption fr-fic fr-dib" style="width: 300px;"><span class="fr-img-wrap"><img src="https://s3-us-west-1.amazonaws.com/wevolver-project-images/froala%2F1646240571681-speechin2.jpg" style="width: 300px;" class="fr-fic fr-dib" alt="An image showing the SpeeChin wearable with silver chain, LEDs, lens, 3D printed case, weight-balancing coin, and FPC cable to a Raspberry Pi. The data flow is also shown: footage capture, pre-processing, passing through the SpeechNet model, and recognition of silent speech commands."><span class="fr-inner">The SpeeChin sits around the wearer's neck to pick up on unvocalized silent speech commands, with surprisingly accurate results in ideal conditions.<br></span></span></span></p><p>Trained on an augmented dataset — boosted by splitting captured footage’s 60 frames per second into two samples at 30 frames per second plus randomized affine transformation to simulate translation and rotation — the model was used across two primary studies: One with 10 participants testing 54 English-language commands, and another with a further 10 participants using 44 Mandarin commands.</p><p>The commands chosen for both languages ranged from digits and smartphone-related interaction tasks like call answering and media playback to punctuation, text handling, and common voice assistant wake-phrases like “Alexa” and “Hey, Siri.” The results are impressive: The English-language test completed with a 90.5 per cent accuracy, while the Mandarin test hit 91.6 per cent.</p><p>A third test tried out “non-words” in an effort to determine the SpeeChin system’s ability to extend to the ability to recognize individual phonemes and thus greatly expand its recognizable vocabulary. Performance here was weaker, but showed enough promise — particularly in being able to distinguish between phonemes involving the tongue, despite it being hidden from the camera’s view — for the team to consider implementing a phoneme-based variant in the future.</p><h1>Work in progress</h1><p>SpeeChin isn’t quite ready to replace audibly-spoken voice command technology just yet, however. The team admitted to weak user-independent performance — 54.4 per cent and 61.2 per cent in English and Mandarin tests respectively, with a high standard deviation — which could be improved by training a user-adaptive model.</p><p>A bigger issue is in the system’s use in mobile settings, where it would arguably be of most use. In a six-participant study, users were given the freedom to walk around while being fed instructions on commands to use via speakers: Differences in users’ walking styles and head movement dropped the accuracy to 72.3 and 65.5 per cent for English and Mandarin respectively in a reduced test set of just 10 phrases each — an issue the team suggests could be corrected through a change in the necklace’s design to reduce movement, stronger post-processing, the collection of a larger-scale training dataset, or the introduction of an activation gesture to trigger recognition.</p><p><span class="fr-img-caption fr-fic fr-dib" style="width: 300px;"><span class="fr-img-wrap"><img src="https://s3-us-west-1.amazonaws.com/wevolver-project-images/froala%2F1646240694251-speechin3.jpg" style="width: 300px;" class="fr-fic fr-dib" alt="Three images captured by the SpeeChin camera: the first with no sunlight, showing a clear view of the users; the second under strong sunlight showing a more muddied view with background noise. The third image shows a higher-performance IR camera, the Leap Motion, delivering better results."><span class="fr-inner">The team has proposed a move to a different infrared camera platform to address problems with strong sunlight.<br></span></span></span></p><p>Other areas to be improved include the prototype’s power consumption, which draws 5.4W excluding the deep-learning system running on a considerably more powerful external server, the camera’s sensitivity to strong sunlight, and the influence of clothing and hair which can occlude the user.</p><p>The team’s work has been published under closed-access terms in the <cite><a href="https://dl.acm.org/doi/10.1145/3494987" target="_blank">Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies</a></cite>.</p><h1>Reference</h1><p>Ruidong Zhang, Mingyang Chen, Benjamin Steeper, Yaxuan Li, Zihan Yan, Yizhuo Chen, Songyun Tao, Tuochao Chen, Hyunchul Lim, and Cheng Zhang: <cite>SpeeChin: A Smart Necklace for Silent Speech Recognition, Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies Vol. 5 Iss. 4</cite>. DOI <a href="https://doi.org/10.1145/3494987" target="_blank">10.1145/3494987</a>.</p>

The SpeeChin prototype is worn around the neck to capture facial movements via an upwards-angled infrared camera.

Designed as a necklace-style wearable in a 3D-printed case, SpeeChin is capable of recognizing 54 English and 44 Chinese voice commands — even if the wearer never says anything out loud.

SpeeChin aims to boost privacy by using silent speech recognition for smartphone control

<p dir="ltr" id="isPasted">As technological advances come through, humans and robots are working more closely together to increase the productivity of industries and the quality of manufactured products, resulting in improved efficiency and growth. The research interest is to design humanoid robots that can become co-workers more than mere tools. From industrial robots to domestic and service robots, roboticists and computer engineers are witnessing the need for human-robot collaboration. For deploying robotic systems to work alongside human resources, it is important for humans to trust the abilities of their functionalities and willingness to use the robot as a co-worker.&nbsp;</p><p dir="ltr">Human-robot interaction has been widely studied in the past decade, evaluating robotic failures and varying severity in terms of impactful consequences. However, the existing research evaluation was restricted to artificial settings which lacked real-life external parameters, resulting in an inaccurate response. Personal relevance (PeR), defined as the level of involvement with an object (in this case, Robot) has been impacting the user preferences and perceptions of the robots. Celsi and Olson found that PeR affects human perception [1] which is why a group of scientists from the Ben-Gurion University of the Negev, in Israel [2] speculated that this will affect robotic failures’ perception.&nbsp;</p><h2 dir="ltr">The Evaluation</h2><p dir="ltr">In the research article, “Is it personal? The impact of personally relevant robotic failures (PeRFs) on humans' trust, likeability, and willingness to use the robot,” the team carried out a study to evaluate the factors that affect how humans trust the robots– without affecting the productivity. The paper primarily focuses on the impact of personally relevant robotic failures (PeRFs) which would reduce the trust in robots and robots’ likeability and willingness to use more than failures that are not personal to the user.&nbsp;</p><p dir="ltr">While the existing research failed to evaluate the factors in real-life scenarios, the team carried out a series of three experiments in the experimental environment, designed to simulate a realistic laundry sorting setup. To investigate the role of PeR in human-robot interaction, the three different laboratory experiments included one with damaging to property, the second with causing financial losses, followed by the first-person versus third-person failure scenarios. For the collaborative task of laundry sorting, a total of 132 participants engaged with the robot with the results indicating the impact of PeRFs on perceptions of the robot differed across the experimental setups.&nbsp;</p><p dir="ltr"><span class="fr-img-caption fr-fic fr-dib" style="width: 766px;"><span class="fr-img-wrap"><img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjQ1Njg4MDQ4OTY2LVJvYm90aWMtSHVtYW4gSW50ZXJhY3Rpb24ucG5nIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" style="width: 800px;" class="fr-fic fr-dib" alt="Summary of Experiment 1 to check user preference after robotic failures"><span class="fr-inner" sapling-id="c0457644-9444-41d7-8754-bd0a3c2e7bd3" sapling-input-id="386deafc-a898-4a2f-957a-5553bf99db65" spellcheck="false">Experiment 1: The interaction between the level of personal relevance and the session in terms of trust and willingness to use. [Image Credit: Research Paper]</span></span></span></p><div is-sapling-overlay="true" style="pointer-events: none; overflow: hidden; padding-bottom: 2px; z-index: auto; position: absolute; left: 0px; top: 477.7px; height: 63px; width: 766px; font-style: normal; font-variant: normal; font-weight: 400; font-stretch: 100%; font-size: 14px; font-family: &quot;PT Serif&quot;, serif; text-align: center; text-transform: none; letter-spacing: normal; word-spacing: 0px; tab-size: 8;"></div><p></p><div style='pointer-events: none; overflow: hidden; padding-bottom: 2px; z-index: auto; position: absolute; left: 0px; top: 477.5px; height: 63px; width: 766px; font-style: normal; font-variant: normal; font-weight: 400; font-stretch: 100%; font-size: 14px; font-family: "PT Serif", serif; text-align: center; text-transform: none; letter-spacing: normal; word-spacing: 0px; tab-size: 8;'><br></div><p>Specifically, in the first experiment, the team aims to evaluate the impact of a failure that may cause damage to participants and examine the interaction between PeR and perceived failure severity. The severity differed from being high when the robot dropped a clothing object into the trash can instead of the laundry bin while the severity dropped when the robot dropped the clothing item onto the floor. The second experiment of financial loss due to delays caused by robotic failures reported that the failures with PeR can negatively impact humans’ trust in robots. The results from experiment two suggest that the perceived trust before failure was more than trust after failure, indicating that the failures decreased the user’s trust.&nbsp;</p><p dir="ltr">Finally, in the last experimental setup, the failures were wrong gender identification of the participant or the experimenter. The conversation between the robot and the participant was in Hebrew, a gendered language that addresses the other person specifying the person’s gender. In high PeR, the robot incorrectly identified the participant’s gender while the lower PeR suggested that the robot incorrectly identified the experimenter’s gender. Surprising in this result, there was no difference between trust before failure and trust after failure, while no difference between LWtU before failure and after failure. This indicated that the manipulation of the interaction PeRF had no impact on the participant.&nbsp;</p><p dir="ltr">The findings of the research article indicate that the robot’s failure changed human perception and impacted the extent to which users are ready to trust a robot for its designed functionality. The willingness to use had been affected by the robot’s failure which sparked an interesting observation fueling future studies. This research article was published on Cornell University’s research sharing platform, arXiv under <a href="https://arxiv.org/abs/2201.05322" target="_blank">open access terms</a>. &nbsp;&nbsp;</p><h2 dir="ltr">Reference</h2><p dir="ltr">[1] R. L. Celsi and J. C. Olson, “The Role of Involvement in Attention and Comprehension Processes,” JOURNAL OF CONSUMER RESEARCH, vol. 15, pp. 210–224, 1988.</p><p dir="ltr">[2] Romi Gideoni, Shanee Honig, Tal Oron-Gilad: Is it personal? The impact of personally relevant robotic failures (PeRFs) on humans' trust, likeability, and willingness to use the robot. DOI <a href="https://arxiv.org/abs/2201.05322" target="_blank">arXiv:220105322</a> [cs.RO]</p>

The robotic-human interaction experimentation– Laundry Sorting Workstation [Image Credit: Research Paper]

Impact of personally relevant robotic failures (PeRFs) which would reduce trust in robots and robots’ likeability and willingness to use more than failures that are not personal to the user. 


Did personally relevant robotic failures affect human perception?

<p id="isPasted">The images made headlines around the world in late 2018. David Mzee, who had been left paralyzed by a partial spinal cord injury suffered in a sports accident, got up from his wheelchair and began to walk with the help of a walker. This was the first proof that Courtine and Bloch’s system – which uses electrical stimulation to reactivate spinal neurons – could work effectively in patients.</p><p><span class="fr-video fr-deletable fr-fvc fr-dvb fr-draggable" contenteditable="false" draggable="true"><iframe src="https://www.youtube.com/embed/4wUADfnCMdc?&amp;wmode=opaque&amp;rel=0&amp;enablejsapi=1&amp;origin=https://www.wevolver.com" frameborder="0" allowfullscreen="" class="fr-draggable" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true" style="width: 767px; height: 437px;"></iframe></span></p><p>Fast forward three years, and a new milestone has just been reached. The research team led by both Courtine, a professor at EPFL, and Bloch, a professor and neurosurgeon at CHUV, has enhanced their system with more sophisticated implants controlled by artificial-intelligence software. These implants can stimulate the region of the spinal cord that activates the trunk and leg muscles. Thanks to this new technology, three patients with complete spinal cord injury were able to walk again outside the lab. “Our stimulation algorithms are still based on imitating nature,” says Courtine. “And our new, soft implanted leads are designed to be placed underneath the vertebrae, directly on the spinal cord. They can modulate the neurons regulating specific muscle groups. By controlling these implants, we can activate the spinal cord like the brain would do naturally to have the patient stand, walk, swim or ride a bike, for example.”</p><h2><strong>Activating motor sequences at the push of a button</strong></h2><p>On a cold, snowy day last December, Michel Roccati – an Italian man who became paralyzed after a motorcycle accident four years earlier – braved the icy wind to try out the system outdoors, in central Lausanne. He had recently undergone the surgical procedure in which Bloch placed the new, implanted lead on his spinal cord.<br>Scientists from the Courtine and Bloch’s .NeuroRestore research center were with him, helping to prepare the demonstration. They attached two small remote controls to Michel’s walker and connected them wirelessly to a tablet that forwards the signals to a pacemaker in Michel’s abdomen. The pacemaker in turn relays the signals to the implanted spinal lead that stimulates specific neurons, causing Michel to move. When he was ready, Michel grasped the walker and set off. He pressed the button on the right side of the walker with the firm intention of taking a step forward with his left leg. His left foot rose like magic and fell to the ground a few centimeters ahead. He then did the same thing with the button on his left side, and his right foot moved forward. He was walking! “The first few steps were incredible – a dream come true!” he says. “I’ve been through some pretty intense training in the past few months, and I’ve set myself a series of goals. For instance, I can now go up and down stairs, and I hope to be able to walk one kilometer by this spring.”</p><p><span class="fr-img-caption fr-fic fr-dib" style="width: 766px;"><span class="fr-img-wrap"><img src="https://s3-us-west-1.amazonaws.com/wevolver-project-images/froala%2F1644544468002-ezgif-5-e5d9eb5e93.jpg" style="width: 766px;" class="fr-fic fr-dib"><span class="fr-inner">Michel Roccati stands up and walks in Lausanne. © EPFL / Alain Herzog 2021&nbsp;</span></span></span></p><p>Two other patients have also successfully tested the new system, which is described in an <a href="https://www.nature.com/articles/s41591-021-01663-5" rel="noopener" target="_blank">article appearing today in Nature Medicine</a>. “Our breakthrough here is the longer, wider implanted leads with electrodes arranged in a way that corresponds exactly to the spinal nerve roots,” says Bloch. “That gives us precise control over the neurons regulating specific muscles.” Ultimately, it allows for greater selectivity and accuracy in controlling the motor sequences for a given activity.</p><h2><strong>One day is all it takes</strong></h2><p>Extensive training is obviously necessary for patients to get comfortable using the device. But the pace and scope of rehabilitation is amazing. “All three patients were able to stand, walk, pedal, swim and control their torso movements in just one day, after their implants were activated!” says Courtine. “That’s thanks to the specific stimulation programs we wrote for each type of activity. Patients can select the desired activity on the tablet, and the corresponding protocols are relayed to the pacemaker in the abdomen.”</p><p><span class="fr-img-caption fr-fic fr-dib" style="width: 766px;"><span class="fr-img-wrap"><img src="https://s3-us-west-1.amazonaws.com/wevolver-project-images/froala%2F1644544498412-ezgif-5-2264b1550c.jpg" style="width: 766px;" class="fr-fic fr-dib"><span class="fr-inner">Thanks to his implant, Michel Roccati can now stand to enjoy a drink. © EPFL / Alain Herzog 2021&nbsp;</span></span></span></p><p>While the progress achievable in a single day is astonishing, the gains after several months are even more impressive. The three patients followed a training regimen based on the stimulation programs and were able to regain muscle mass, move around more independently, and take part in social activities like having a drink standing at a bar. What’s more, because the technology is miniaturized, the patients can perform their training exercises outdoors and not only inside a lab.</p><p>“This study further demonstrates the benefits of our approach,” says Courtine. “We’re now working with <a href="http://onwd.com/" rel="noopener" target="_blank">ONWARD Medical</a>, which recently listed on Euronext, to turn our discoveries into genuine treatments that can improve the lives of thousands of people around the world.”</p><hr><p><strong id="isPasted">References</strong></p><p>Activity-dependent spinal cord neuromodulation rapidly restores trunk and leg motor functions after complete paralysis, Nature Medicine, February 7 2022, DOI: https://doi.org/10.1038/s41591-021-01663-5</p>

 Michel Roccati stands up and walks in Lausanne. © EPFL / Alain Herzog 2021

A system developed by Grégoire Courtine and Jocelyne Bloch now enables patients with a complete spinal cord injury to stand, walk and even perform recreational activities like swimming, cycling and canoeing. 

New implant offers promise for the paralyzed

<p>In this episode, we talk about how a new wearable device can combat fatigue and how monitoring BAC via sweat can be a new use case for wearables. As always, you can find these and other interesting &amp; impactful engineering articles on Wevolver.com.</p><p><span class="fr-video fr-deletable fr-fvc fr-dvb fr-draggable" contenteditable="false" draggable="true"><iframe height="200px" width="100%" frameborder="no" scrolling="no" seamless="" src="https://player.simplecast.com/c866dfbc-964d-4828-b95e-edf2ff87e8da?dark=false" class="fr-draggable"></iframe></span>&nbsp;</p><hr><p>This podcast is sponsored by <a href="https://www2.mouser.com/" id="isPasted" rel="nofollow" target="_blank">Mouser Electronics</a>.&nbsp;</p><p><img src="https://s3-us-west-1.amazonaws.com/wevolver-project-images/froala%2F1644321153399-Mouser-sponsor-1-a.jpg" style="width: 766px;" class="fr-fic fr-dib"></p><hr><h3 id="isPasted">EPISODE NOTES</h3><p>(3:00) - <a href="https://www.wevolver.com/article/energizing-the-brain-combating-worker-fatigue-using-wearable-neurotechnology/" target="_blank">Energizing The Brain🧠⚡️</a></p><p>(14:35) - <a href="https://www.wevolver.com/article/can-wearable-technology-predict-the-negative-consequences-of-drinking/" target="_blank">Wearables For Alcohol Consumption⌚️🍻</a></p><p>Episode 56 was brought to you by Mouser Electronics, Farbod &amp; Daniel’s favorite electronics distributor. Click <a href="https://www.mouser.com/applications/article-iot-wearable-devices/" target="_blank">here&nbsp;</a>to read the article giving an overview of how wearable electronics are transitioning away from being peripheral devices.</p><hr><p id="isPasted">About the podcast:</p><p>Every day, some of the most innovative universities, companies, and individual technology developers share their knowledge on Wevolver. To ensure we can also provide this knowledge for the growing group of podcast listeners, we started a collaboration with two young engineers, Daniel Scott Mitchell &amp; Farbod Moghaddam who discuss the most interesting content in this podcast series.&nbsp;</p><p>To learn more about this show, please visit the <a href="https://www.wevolver.com/profile/the.next.byte" target="_blank">shows page</a>. By following the page, you will get automatic updates by email when a new show is published.</p><p>Be sure to give us a follow and review on <a href="https://podcasts.apple.com/nl/podcast/the-next-byte/id1548255861?l=en" rel="nofollow" target="_blank">Apple</a> podcasts, <a href="https://open.spotify.com/show/6lPPsRtegnivsRUEsQ09R7?si=IPMiah7xT_apJtPjqvXMlA" rel="nofollow" target="_blank">Spotify</a>, and most of your favorite podcast platforms!</p>

Out of the counterbalance of anodal stimulation, sham stimulation and no stimulation, the team found that by exciting neuronal activity through anodal stimulation, task performance under fatigue improved, while it decreased under the other two sessions. | Image: Getty Images

In this episode, we talk about how a new wearable device can combat fatigue and how monitoring BAC via sweat can be a new use case for wearables. 

Podcast: Wearables For Combating Fatigue & Monitoring Alcohol Consumption

<p id="isPasted"><a href="https://sites.google.com/site/tapomayukh/home" target="_blank">Tapomayukh Bhattacharjee</a> has been working on assistive robotics for approximately a decade, and in speaking to the people who would benefit from new technologies, he’s come to a few realizations.</p><p>“I started chatting a lot with the stakeholders – people with mobility limitations, the caregivers who are helping them, and occupational therapists – and I felt like robotics can truly make a difference in their lives, when it’s ready to be deployed,” said Bhattacharjee, hired in July 2021 as an assistant professor of computer science in the Cornell Ann S. Bowers College of Computing and Information Science.</p><p><span class="fr-video fr-deletable fr-fvc fr-dvb fr-draggable" contenteditable="false" draggable="true"><iframe src="https://www.youtube.com/embed/f-NboRkoTDs?&amp;wmode=opaque&amp;rel=0" frameborder="0" allowfullscreen="" class="fr-draggable" style="width: 768px; height: 439px;"></iframe></span><em>Tapomayukh Bhattacharjee received a National Robotics Initiative collaborative grant for a project that aims to address the way people with mobility issues are given a chance for improved control and independence over their environments, especially how they are fed.&nbsp;</em></p><p id="isPasted">Among the basic activities of daily living that robotics could impact, Bhattacharjee is currently focused on eating. And a&nbsp;<a href="https://www.nsf.gov/awardsearch/showAward?AWD_ID=2132846&HistoricalAwards=false" target="_blank">four-year, $1.5 million grant</a> from the National Science Foundation’s National Robotics Initiative will help him and his&nbsp;<a href="https://emprise.cs.cornell.edu/" target="_blank">EmPRISE Lab</a> develop assistive robotics for people with physical disabilities and their caregivers.</p><p>“Feeding is one of the most basic activities,” he said. “Imagine yourself asking someone else to feed you every morsel of food in your day-to-day life. It just completely takes away the sense of independence. And so, if we could solve this feeding challenge, if a person could perceive this robot as an extension of their own body, then they will feel much more independent. That’s why I am so passionate about solving this.”</p><p>Bhattacharjee – who received his Ph.D. in 2017 from the Georgia Institute of Technology, and developed a prototype robot during his postdoctoral work at the University of Washington prior to joining the Cornell Bowers CIS faculty – fully understands the nature of the challenge in front of him.</p><p>“Despite great strides taken toward sustainable solutions in controlled environments,” he wrote in his grant proposal, “robots are far from ready for adoption in real-home environments as long-term caregiving solutions.”</p><p>To address the eating challenge, Bhattacharjee will focus on three key elements:</p><ul><li><strong>Bite acquisition:</strong> His team will derive algorithms that learn by obtaining human feedback – which they refer to as human-in-the-loop manipulation – to perform difficult tasks related to eating, particularly with different forms of food;</li><li><strong>Bite transfer:</strong> The goal is to develop safe control and learning algorithms for bite transfer – that is, the robot actually placing the food safely in a person’s mouth, particularly if the person has profound physical limitations and cannot move to take the food; and</li><li><strong>Feeding with user preferences:</strong> The team will develop active learning and shared autonomy algorithms that capture, over time, human preferences of bite transfer trajectories.</li></ul><p>“The main lessons we learned in our experiments [at Washington] was that every user is different,” he said. “Everybody has their personal preferences. And if we really want a long-term caregiving solution, the solution needs to be personalized to the user. And just like a patient and a caregiver need time to get used to each other, it’s the same with a patient and a robot.”</p><p>The main target population Bhattacharjee is focusing on with his assistive technology is people with spinal cord injuries – those who are limited physically but not necessarily cognitively, so they would be able to help train the robot.</p><p>One key element of the work will be leveraging the idea of human feedback – specifically by embracing the inevitable physical contact between the robot and human, such as when placing the utensil inside the mouth.</p><p>“If you think about robots in airports, self-driving cars, robots in grocery stores, it’s all about avoiding obstacles,” Bhattacharjee said. “But realistically, if I’m grabbing for something, my arm might touch something else, right? The whole point is, can we leverage this contact, while being safe and efficient at the same time?”</p><p>The grant period starts Jan. 1, 2022, and runs through 2025.</p>

Doctoral student Rajat Kumar Jenamani, a member of Tapomayukh Bhattacharjee’s EmPRISE Lab, prepares to take a piece of a banana from an assistive robot prototype. Ryan Young/Cornell University

Tapomayukh Bhattacharjee has been working on assistive robotics for approximately a decade, and in speaking to the people who would benefit from new technologies, he’s come to a few realizations.

Robot-assisted feeding the focus of 1.5M USD NSF grant

<p>In this episode, we talk about a blind cane from Stanford University that borrows self-driving tech to increase the mobility of visually-impaired people by 20% as well as an effort from Texas A&amp;M to develop enhanced touchscreens which will enable users to feel textures on their smart devices. As always, you can find these and other interesting &amp; impactful engineering articles on Wevolver.com.&nbsp;</p><p><span class="fr-video fr-deletable fr-fvc fr-dvb fr-draggable" contenteditable="false" draggable="true"><iframe height="200px" width="100%" frameborder="no" scrolling="no" seamless="" src="https://player.simplecast.com/56dfea3f-88e3-4e7c-b408-230412dd1710?dark=false" class="fr-draggable"></iframe></span><br></p><hr><p>This podcast is sponsored by <a href="https://www2.mouser.com/" id="isPasted" rel="nofollow" target="_blank">Mouser Electronics</a>.&nbsp;</p><p><img src="https://s3-us-west-1.amazonaws.com/wevolver-project-images/froala%2F1635224345737-Mouser-sponsor-1-a.jpg" style="width: 766px;" class="fr-fic fr-dib"></p><hr><h3 id="isPasted">PISODE NOTES</h3><p>(1:03) - <a href="https://www.wevolver.com/article/researchers-build-400-usd-self-navigating-smart-cane" target="_blank">Self-navigating Smart Cane</a><br>&nbsp;</p><p>(15:16) - <a href="https://www.wevolver.com/article/enhanced-touch-screens-could-enable-users-to-feel-objects" target="_blank">Enhanced Touchscreens</a><br>&nbsp;</p><p>Episode 41 was brought to you by Mouser Electronics, Farbod &amp; Daniel’s favorite electronics distributor. Click <a href="https://www.mouser.com/createthefuture/" target="_blank">here</a> to learn more about Mouser's Create the Future Design Contest.</p><hr><p id="isPasted">About the podcast:</p><p>Every day, some of the most innovative universities, companies, and individual technology developers share their knowledge on Wevolver. To ensure we can also provide this knowledge for the growing group of podcast listeners, we started a collaboration with two young engineers, Daniel Scott Mitchell &amp; Farbod Moghaddam who discuss the most interesting content in this podcast series.&nbsp;</p><p>To learn more about this show, please visit the <a href="https://www.wevolver.com/profile/the.next.byte" target="_blank">shows page</a>. By following the page, you will get automatic updates by email when a new show is published.</p><p>Be sure to give us a follow and review on <a href="https://podcasts.apple.com/nl/podcast/the-next-byte/id1548255861?l=en" rel="nofollow" target="_blank">Apple</a> podcasts, <a href="https://open.spotify.com/show/6lPPsRtegnivsRUEsQ09R7?si=IPMiah7xT_apJtPjqvXMlA" rel="nofollow" target="_blank">Spotify</a>, and most of your favorite podcast platforms!</p><p>Take a few seconds to leave us a review. It really helps!&nbsp;</p><p><a href="https://apple.co/2RIsbZ2" rel="nofollow" target="_blank">https://apple.co/2RIsbZ2</a></p><p>if you do it and send us proof, we’ll give you a shoutout on the show.</p>

In this episode, we talk about a blind cane from Stanford University that borrows self-driving tech to increase the mobility of visually-impaired people by 20% as well as an effort from Texas A&M to develop enhanced touchscreens which will enable users to feel textures on their smart devices.

Podcast: The Tesla of Blind Canes

<p>YOLO is a non-anthropomorphic social robot designed to stimulate creativity in children. This robot was envisioned to be used by children during free-play where they use the robot as a character for the stories they create. During play, YOLO makes use of creativity techniques that promote the creation of new storylines.&nbsp;</p><p>Therefore, the robot serves as a tool that has the potential to stimulate creativity in children during the interaction. Particularly, YOLO can stimulate divergent and convergent thinking for story creations. Additionally, YOLO can have different personalities, providing it with socially intelligent and engaging behaviors.&nbsp;</p><p>This work provides open-source and open access to YOLO’s hardware. The design of the robot was guided by psychological theories and models on creativity, design research including user-centered design practices with children, and informed by experts working in the field of creativity.&nbsp;</p><p>Specifically, it relies on established theories of personality to inform the social behavior of the robot, and on theories of creativity to design creativity stimulating behaviors. The design decisions were then based on design fieldwork with children.&nbsp;</p><p>The end product is a robot that communicates using non-verbal expressive modalities (lights and movements) equipped with sensors that detect the playful behaviors of children. YOLO has the potential to be used as a research tool for academic studies, and as a toy for the community to engage in personal fabrication.&nbsp;</p><p>The overall benefit of this proposed hardware is that it is open-source, less expensive than existing ones, and one that children can build by themselves under expert supervision.</p><p><span class="fr-video fr-deletable fr-fvc fr-dvb fr-draggable" contenteditable="false" draggable="true"><iframe src="https://www.youtube.com/embed/e-K3J5UZ9M4?&amp;wmode=opaque&amp;rel=0" frameborder="0" allowfullscreen="" class="fr-draggable" style="width: 789px; height: 450px;"></iframe></span><br></p><p><strong>Design&nbsp;</strong></p><p>YOLO was designed using formative research and feasibility studies. Formative research consists of an exploratory research methodology whose goal is to guide a design process, allowing ongoing intermediate assessments. By identifying and solving concrete usability problems throughout the entire process design, current systems can be improved or new ones are developed.&nbsp;</p><p>Feasibility studies consist of are pieces of research performed before the main study, used to estimate crucial parameters that are needed to design the main study. These intermediary studies will help to prepare for full-scale and large research intervention, allowing for low-cost improvements before experimentally testing the effectiveness of interventions or products. Additionally, the Double-Diamond Design Process Model was used to design YOLO, an established theory in the field of design research.&nbsp;</p><p>The contextual design was used by involving children at different design stages of the robot. The importance of contextual design lies in the fact that it validates the already embodied system where the robot will exist, capturing the child’s world as the floor for design decisions. Data gathered during fieldwork was the base criterion for deciding what needs to be addressed, what the robot should do, and how it should be structured within the reality of children. Additionally, the Big Five Model of Personality informs the design of the social behaviors for the robot.&nbsp;</p><p>Finally, the robot was aimed to stimulate creativity during play. Therefore, the creativity-stimulating behavior of YOLO was based on two established creativity techniques for idea generation, an important stage in story creation. These techniques are called ‘‘contrast” and ‘‘mirror”. While the Contrast technique stimulates divergent thinking, the Mirror technique is responsible for the development of convergent thinking. Both modes of thinking are required to establish the emergence of creativity.&nbsp;</p><p>Therefore, YOLO’s behavior is not only loaded with social behaviors (derived from personality theories) but also with behaviors that can lead to creativity stimulation in children.</p><p><br></p><p><span class="fr-img-caption fr-fic fr-dib" style="width: 736px;"><span class="fr-img-wrap"><img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjE5NjQzODg5NDE1LTQuanBnIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" style="width: 736px;" class="fr-fic fr-dib"><span class="fr-inner" spellcheck="false">YOLO’s exploded view (on the left) and section analysis with component coloring (on the right)</span></span></span></p><p>The design files are in STL format and ready to be 3D printed. Some of these files can be converted to a DXF format, adding a laser cutting option for faster and cheaper opportunities to fabricate YOLO. If opting to laser cut some of the components, note that the thickness of the laser cutting material should correspond to the CAD model dimensions.</p><p><br></p><ul><li>Shell– File with the cover of the robot. This is the largest 3D printing file and requires a 3D printer capable of operating at large dimensions – at least 120x200x200 mm of printing capability. Consider a vertical bottom-up position for printing the shell. Support material should be added to the faces of the three tabs. This design file does not present a laser cutting option as it is made of 3D organic shapes not ideal for laser cutting work.</li><li>Batteries, boards, and wheel layers– These design files are composed of three circular platforms that should be placed on the interior of the shell to hold all the electronic components in place. Consider printing the layers horizontally. Support material is needed only on the face of the counter-bore holes of the larger platform. The laser cutting options valid for this design file.</li><li>Jewel layer– This file contains the design that serves to nest the LED jewel that will be attached from the top of the shell. Consider printing the LED nest horizontally with support material. This file does not support a laser cutting option due to its 3D design requirement.</li><li>Glowing fibers layer– This design file contains the plate where the optical fibers should be glued. Consider printing the LED nest horizontally with support material. The laser cutting option is valid for this design file.</li><li>Washer– Washers should be placed between the ‘‘Jewel layer” and the ‘‘glowing fibers layer” to secure this connection. YOLO uses three washers to support this connection, so consider printing 3 parts. The laser cutting option is valid for this design file.</li><li>Motor docking (1) and (2)– Composed of two files that together provide docking for the motors. Support material is not needed for 3D printing. The laser cutting option is valid for ‘‘Motor docking (2)</li></ul><div class="fr-img-space-wrap"><span class="fr-img-caption fr-fic fr-dib" style="width: 788px;"><span class="fr-img-wrap"><img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjE5NjQzOTc2MTgyLTUuanBnIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" style="width: 758px;" class="fr-fic fr-dib"><span class="fr-inner" spellcheck="false">YOLO Parts Lineup</span></span></span></div><p><strong>Assembly</strong></p><p class="fr-img-space-wrap2">The assembly requires the following tools: hacksaw, utility knife, screwdriver set, calipers, scissors, soldering kit(including solder spool, soldering station, wire stripper, diagonal cutters, solder wick for solder removal, soldering vise with a magnifying glass, and a panavise), and glue. 3D print and laser cut the required materials before assembly, configure the voltage transformer with an input of 5.0 V, and stepdown the buck converter output for 1.5 V. Additionally, follow the steps described below</p><p class="fr-img-space-wrap2"><img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjE5NjQ0MzY4MTI2LTYuanBnIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" style="width: 723px;" class="fr-fic fr-dib"></p><div><br></div><p>An exploded view of YOLO that supports the understanding of the final robot configuration is present, with close-up views. When the robot is fully assembled, attach a batch of copper tape to the shell of the robot to connect the wire that comes from the capacitive touch sensor. This will enable the robot to respond to touch</p><p><img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjE5NjQ0NTI2ODg4LTcuanBnIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" style="width: 788px;" class="fr-fic fr-dib"></p><div><br></div><p>The field of HRI is characterized by multidisciplinarity, for which open access to research tools, such as robots’ hardware and software, is crucial. YOLO presents as a low-purchase and low-maintenance cost robot, that can be used as a tool for research studies with children.&nbsp;</p><p>The open-source hardware of YOLO thus provides opportunities for researchers with and without engineering background to build this robot and further use it to target their own research goals, without depending upon complex robotic platforms.&nbsp;</p><p>To demonstrate how this robot can be applied to academia, researchers can use it as a platform to explore the design of behaviors for a robot aimed at interacting with children. Another example is the usage of this robot by the social and cognitive sciences field as a controllable and programmable tool, to study the developmental aspects of children when interacting with robots.&nbsp;</p><p>Predominantly, the scientific community relies on the usage of off-the-shelf robots as their research platforms when performing studies. Nonetheless, off-the-shelf robotics platforms are generally expensive (with purchase prices ranging from $5:000 to $20:000, or more) and associated with high maintenance costs. In addition, the majority of these robots require special transportation services to be used during field studies, due to their robust size and heavyweight, placing additional costs for academic laboratories. YOLO offers a less expensive yet interesting solution for research.</p><hr><h3><strong>Resources</strong></h3><p>YOLO hardware:&nbsp;</p><p>Alves-Oliveira, P., Arriaga, P., Paiva, A., &amp; Hoffman, G. (2019). Guide to build YOLO, a creativity-stimulating robot for children. <em>HardwareX</em>, <em>6</em>, e00074. Link: <a data-saferedirecturl="https://www.google.com/url?q=https://www.sciencedirect.com/science/article/pii/S2468067218300890&source=gmail&ust=1620392946091000&usg=AFQjCNFJ1CSA2ore98RXkgL20qiBk6G6gw" href="https://www.sciencedirect.com/science/article/pii/S2468067218300890" target="_blank">https://www.<wbr>sciencedirect.com/science/<wbr>article/pii/S2468067218300890</a></p><p>YOLO Software:&nbsp;</p><p>Alves-Oliveira, P., Gomes, S., Chandak, A., Arriaga, P., Hoffman, G., &amp; Paiva, A. (2020). Software architecture for YOLO, a creativity-stimulating robot. <em>SoftwareX</em>, <em>11</em>, 100461. Link: <a data-saferedirecturl="https://www.google.com/url?q=https://www.sciencedirect.com/science/article/pii/S2352711019302468&source=gmail&ust=1620392946091000&usg=AFQjCNEjWO-hCwkOhQw5LtcD72GDY9iFKw" href="https://www.sciencedirect.com/science/article/pii/S2352711019302468" target="_blank">https://www.<wbr>sciencedirect.com/science/<wbr>article/pii/S2352711019302468</a></p>

YOLO is a robot that boosts children’s creativity. It stand for “Your Own Living Robot"

YOLO Robot

<p>Mark R. Cutkosky is the Fletcher Jones Professor in the Dept. of Mechanical Engineering at Stanford University. He joined Stanford in 1985, after working in the Robotics Institute at Carnegie Mellon University and as a design engineer at ALCOA, in Pittsburgh, PA. He received his Ph.D. in Mechanical Engineering from Carnegie Mellon University in 1985.</p><p>Cutkosky’s research activities include robotic manipulation and tactile sensing and the design and fabrication of biologically inspired robots. He has graduated 48 Ph.D. students and published extensively in these areas. He consults with companies on robotics and human/computer interaction devices and holds several patents on related technologies. His work has been featured in Discover Magazine, The New York Times, National Geographic, Time Magazine and other publications and has appeared on PBS NOVA, CBS Evening News, and other popular media.</p><p>Cutkosky’s awards include a Fulbright Faculty Chair (Italy 2002), Fletcher Jones and Charles M. Pigott Chairs at Stanford University, an NSF Presidential Young Investigator award and Times Magazine Best Innovations (2006) for the Stickybot gecko-inspired robot. He is a fellow of ASME and IEEE and a member of Sigma Xi.</p><h1 dir="ltr">Soft Robotics With Mark Cutkosky&nbsp;</h1><p dir="ltr">Marwa ElDiwiny, host of the Soft Robotics podcast, interviews Mark about his work in soft robotics.</p><p dir="ltr"><span class="fr-video fr-deletable fr-fvc fr-dvb fr-draggable" contenteditable="false" draggable="true"><iframe src="https://open.spotify.com/embed-podcast/episode/6237w6uZUttAH7nW4lhAPf" width="100%" height="232" frameborder="0" allowtransparency="true" class="fr-draggable"></iframe></span><br></p>

Cutkosky applies analyses, simulations, and experiments to the design and control of robotic hands, tactile sensors, and devices for human/computer interaction. In manufacturing, his work focuses on design tools for rapid prototyping.

Soft Robotics With Mark Cutkosky "Gecko Climbing Robots"

<p>This article was discussed in our <a data-saferedirecturl="https://www.google.com/url?q=https://www.wevolver.com/profile/the.next.byte&source=gmail&ust=1640817319915000&usg=AOvVaw2nPRdRwJrXSYYeM9RCFu5x" href="https://www.wevolver.com/profile/the.next.byte" id="isPasted" rel="noopener noreferrer" target="_blank">Next Byte podcast</a>.&nbsp;</p><p><span class="fr-video fr-deletable fr-fvc fr-dvb fr-draggable" contenteditable="false" draggable="true"><iframe height="200px" width="100%" frameborder="no" scrolling="no" seamless="" src="https://player.simplecast.com/ef727514-e071-4310-94c3-ab0d48d9b24d?dark=false" class="fr-draggable"></iframe></span></p><p>The full article will continue below.</p><hr><h1>The Digidog</h1><p>The New York Police department purchased a Spot robot from Boston Dynamics - which the department later named Digidog (personally I feel like this is a missed opportunity to call it RoboPup but oh well) - with the intention of providing an extra layer of safety for the officers called to a scene by having the robot inspect the perimeter.&nbsp;</p><h1>First Day On The Job</h1><p>Digidog's first call to action came when two men were being held captive and tortured in their home by armed intruders who were disguised as plumbers to gain entry. When police were eventually called to the scene by one of the captives who managed to escape, they decided to deploy Digidog and get a better idea of the situation inside the building before officers entered. Unfortunately, the intruders had already escaped but the victims were able to walk away from the situation with non life-threatening injuries.&nbsp;</p><p><br></p><p><span class="fr-video fr-deletable fr-fvc fr-dvb fr-draggable" contenteditable="false" draggable="true"><iframe width="640" height="360" src="https://www.youtube.com/embed/24jufNhuUSI?&amp;wmode=opaque&amp;rel=0" frameborder="0" allowfullscreen="" class="fr-draggable"></iframe></span><br></p><h1>Robots On The Force</h1><p>Although this might be the first utilization of a Boston Dynamics Spot by a police department, authorities have actually been getting extra assistance from robotics for quite some time now. In fact, here are some notable instances in recent years:</p><p>2016 | Dallas, Texas: officers naturalized a target that had murdered 5 officers using a robot</p><p>2015 | San Jose, California: robot delivery of some pizza and a phone helped talk down an armed man off the ledge who was planning on jumping off a bridge</p><p>2014 | Albuquerque, New Mexico: gunman surrendered after robot deployed chemical munitions into the motel room where he had barricaded himself</p><h1>The Opposition</h1><p>Skeptics aren't too eager to embrace the addition of our new metallic friends to the force. Some, including congresswoman Alexandria Ocasio Cortez, have voiced their concerns regarding over-policing of underserved communities and the hefty price tag accompanied by each unit (base price = ~74,000 USD) which could be better spent elsewhere; however, since the Digibot has already started to prove its worth by minimizing endangerment of officers in the field, I suspect it is only a matter of time before we start seeing officers and their robotic partners nationwide.</p>

The New York Police Department has started using a robotic companion to ensure the safety of officers in potentially life-threatening environments

Meet Digidog, The Real Life Robocop

With robots in agriculture becoming more of the norm rather than the exception, the term high-tech farming is no longer an oxymoron. Farming robots are now involved in almost every farming activity, helping farmers fill labor shortages and supermarket shelves simultaneously.

The Future of Agriculture: Adopting More Advanced Robots for Next-Gen Farming

<h2><br></h2><h2>The Business</h2><p>Based in Paintsville, KY, eKAMI is a Haas Technical Education Center (HTEC) that is teaching former coal miners, and others seeking career advancement, CNC machining and other advanced manufacturing skills.</p><h2>Task</h2><p>Training future manufacturing professionals in advanced manufacturing.</p><section><h2>The Challenge</h2><p>Manufacturing faces a significant skilled labor shortage, which is expected to reach 3.5 million unfilled advanced manufacturing job openings by 2025. The industry needs more workers armed with the advanced manufacturing skills. Kathy Walker founded eKAMI, a Haas Technical Education Center, to address this need and also create opportunity for former coal miners who had been left behind by evolving energy policy.</p><p>Over their first few years, eKAMI has trained over a hundred workers on CNC machine programming and operation, as well as other advanced manufacturing skills. Despite a 100% job placement rate, Kathy Walker realized that eKAMI must extend the skills of their graduates to include the ability to design, program, deploy, and manage robotic automation. These skills would multiply the impact that each graduate would have at their future employers, and ensure a bright future for eKAMI graduates.</p><p>However, the robotic landscape is extremely fragmented, with 70+ robot OEMs, each with its own difficult-to-learn programming language. Learning to program basic skills on any robot can take weeks, and require base programming knowledge like C+ or Pascal. This wasn’t a workable solution for eKAMI, as it would require greatly increasing the length of their 16-week training course in order to give their students basic robot programming skills - with just ONE robot brand! eKAMI needed a solution that would allow them to rapidly train their students to program multiple brands of robots, and also learn the related components of automation: automated workcell design, parts presentation, safety, programming and troubleshooting robotic automation, etc.</p><h2>The Solution</h2><p>When the eKAMI team discovered READY Robotics they knew they might have found the solution. READY’s Forge/OS enables operators to program multiple brands of robots from a single platform. With intuitive, flow-chart-based programming, Forge/OS drastically reduces the learning curve, enabling anyone to learn basic programming skills in under a day versus the weeks it takes with each robot’s native programming language. More than that, Forge/OS programming skills transfer to multiple top robotic brands, enabling students to become proficient programming Yaskawa, FANUC and other top brands in just a few days. It was clear to eKAMI leadership that building their automation education around Forge/OS would allow students to quickly expand their skillset to include robot programming. Equally importantly, it would also free up enough time for the students to learn the other skills necessary to successful design and deploy automation. READY was already hard at work on educational materials for their customers, and were happy to build and teach a 3-week automation course for eKAMI.</p></section><section><blockquote>Whether you have some knowledge or zero knowledge with robotics, anyone can be easily taught how to run robots (with Forge/OS).</blockquote></section><blockquote>"Kaylee Maynard" - eKAMI Graduate</blockquote><p><img src="https://s3-us-west-1.amazonaws.com/wevolver-project-images/froala%2F1606320390823-left-image.jpg" style="width: 788px;" class="fr-fic fr-dib"></p><section><blockquote>Within a couple of hours of robot time I was doing it (programming robots)!</blockquote></section><blockquote>"Mike Cepeda" - eKAMI Graduate</blockquote><section><p><img src="https://s3-us-west-1.amazonaws.com/wevolver-project-images/froala%2F1606320683797-right-image.jpg" style="width: 788px;" class="fr-fic fr-dib"></p><h2>The Result</h2><p>In August the eKAMI Haas Technical Education Center graduated their first class of students, skilled in both CNC machine programming and operation, as well as automation design, programming and deployment. With a 3-week automation add-on to their 16-week CNC course, this class of eKAMI graduates are able to program machine tools as well as deploy lights out production. Best of all, 3 weeks of automation didn’t just teach them the most basic of robot programming skills that they might have learned through a robot OEM. Instead, they learned how to evaluate potential automation projects, how to design an automated workcell, how to solve parts presentation, how to design and fabricate end-of-arm tooling, how to seamlessly integrate robots with machine tools, how to program robots and deploy automation, how to optimize automated workcells to maximize output, and how to achieve lights out production. With the help of Forge/OS and READY’s automation training curriculum, this class of eKAMI graduates is the first of many that will have the skills needed to help usher in the future of US manufacturing. One where automation is common across manufacturers of all sizes, and one where US manufacturing is once again a global manufacturing leader.</p></section><section><blockquote>If I can do it, anyone can program robots with Forge/OS!</blockquote></section><blockquote>"Tim Miller" - eKAMI Graduate</blockquote><hr><p>Highlights</p><h2>Former coal miners upskilled into automation experts in 3 weeks</h2><p><img src="https://s3-us-west-1.amazonaws.com/wevolver-project-images/froala%2F1606320602394-1606320602394.png" style="width: 788px;" class="fr-fic fr-dib"></p>