{"id":178844,"date":"2022-12-07T14:21:16","date_gmt":"2022-12-07T19:21:16","guid":{"rendered":"https:\/\/web.uri.edu\/gso\/?p=178844"},"modified":"2022-12-07T14:21:16","modified_gmt":"2022-12-07T19:21:16","slug":"orchestration","status":"publish","type":"post","link":"https:\/\/web.uri.edu\/gso\/publications\/aboard-gso\/orchestration\/","title":{"rendered":"Orchestration"},"content":{"rendered":"<section class=\"cl-wrapper cl-hero-wrapper\"><div class=\"cl-hero super   cl-has-accessibility-controls\"><div class=\"cl-hero-proper\"><div class=\"overlay\"><div class=\"block\"><h1>ORCHESTRATION<\/h1><p>This summer, science teams from partner institutions of the Ocean Exploration Cooperative Institute (OECI) deployed three autonomous vehicles at once, then tested the ability of the robots to work in concert.<\/p><\/div><\/div><div class=\"still\" style=\"background-image:url(https:\/\/web.uri.edu\/gso\/wp-content\/uploads\/sites\/916\/AGSO_F22_OECI-Opener_563x1000.jpg);\"><\/div><div class=\"cl-accessibility-controls-container\"><div class=\"cl-accessibility-controls\"><div class=\"cl-accessibility-icon\" title=\"Accessibility controls\">Accessibility controls<\/div><div class=\"cl-accessibility-control cl-accessibility-motion-control cl-accessibility-control-hidden\"><div class=\"cl-accessibility-control-default\"><div class=\"cl-accessibility-control-button\" title=\"Pause motion\">Pause motion<\/div><div class=\"cl-accessibility-control-label\">Motion: <span class=\"cl-accessibility-syntax\">On<\/span><\/div><\/div><div class=\"cl-accessibility-control-alternate\"><div class=\"cl-accessibility-control-button\" title=\"Play motion\">Play motion<\/div><div class=\"cl-accessibility-control-label\">Motion: <span class=\"cl-accessibility-syntax\">Off<\/span><\/div><\/div><\/div><div class=\"cl-accessibility-control cl-accessibility-contrast-control\"><div class=\"cl-accessibility-control-default\"><div class=\"cl-accessibility-control-button\" title=\"Increase text contrast\">Increase text contrast<\/div><div class=\"cl-accessibility-control-label\">Contrast: <span class=\"cl-accessibility-syntax\">Standard<\/span><\/div><\/div><div class=\"cl-accessibility-control-alternate\"><div class=\"cl-accessibility-control-button\" title=\"Reset text contrast\">Reset text contrast<\/div><div class=\"cl-accessibility-control-label\">Contrast: <span class=\"cl-accessibility-syntax\">High<\/span><\/div><\/div><\/div><div class=\"cl-accessibility-system-setting\"><div class=\"cl-accessibility-toggle\" title=\"Apply my preferences site-wide\"><\/div><div class=\"cl-accessibility-toggle-label\">Apply site-wide<\/div><\/div><\/div><\/div><\/div><\/div><\/section>\n<h4>By Hugh Markey; photos courtesy of Ocean Exploration Trust<\/h4>\n<div class=\"type-intro\">\n<hr>\n<p>Scientists, researchers and engineers aboard exploration vessel (E\/V) <em>Nautilus<\/em> successfully dem\u00adonstrated that autonomous uncrewed systems can work collabor\u00adatively during a scientific mission. This latest development in technologies and methods will prove to be a \u201cforce-multiplier\u201d for future ocean exploration.<\/p>\n<\/div>\n<hr>\n<p>Expedition leader Jason Fahy from URI\u2019s GSO discussed the reasons behind the development of this collaborative approach. \u201cThe primary driving force behind this work is to conduct more exploration with a limited amount of resources. Doing multiple things simultaneously results in more and richer data being collected. Instead of conducting three independent operations, each taking up to a day, we can now simultaneously deploy these systems, allowing for a significant time savings but also synchronizing the timing of our data collection. This snapshot in time of what\u2019s happening throughout the oceans depth is extremely powerful.\u201d<\/p>\n<section class=\"cl-wrapper cl-quote-wrapper\"><div class=\"cl-quote  \"><div class=\"cl-quote-image\" style=\"background-image:url(https:\/\/web.uri.edu\/gso\/wp-content\/uploads\/sites\/916\/AGSO_F22_OECI-Fahy_300x300.jpg)\" title=\"\"><\/div><blockquote>\u201cWhere we\u2019re going in the future is to automate that process by using artificial intelligence and machine learning to essentially give more autonomy to the robots to decide what\u2019s important.\u201d<\/blockquote><cite>Jason Fahy, Associate Director, OECI<\/cite><\/div><\/section>\n<p>OECI Executive Director Adam Soule from GSO oversaw the process and noted the cooperative spirit that ran through the whole process. \u201cThe cooperative institute is in its third year, and it works with federal agencies, NOAA, and academic partners. All of these are members of the partnership. There is also cooperation among the operations teams for these vehicles, which is beneficial. It\u2019s exciting to see the vehicles cooperate with each other.\u201d<\/p>\n<p>Fahy explains the ideal operation they hoped for. \u201cWe have an autonomous surface vessel mapping the sea floor and collecting oceanographic information; at the same time, a very quiet autonomous underwater vehicle (AUV) taking observations hundreds of meters below the surface; and finally another AUV up to 5000 meters below collecting samples and capturing imagery of the seafloor. Not only are we streaming all this exploration over the internet, but the public and scientific community can now have a glimpse of what\u2019s happening throughout the water column at the exact same time.\u201d<\/p>\n<p>Preparation for the cruise was complex, and even mundane issues needed to be worked out prior to the cruise. \u201cThere are so many different challenges,\u201d Soule said. \u201cOne logistical challenge is that ships have a limited number of berths. And each one of these vehicles has a team of five to ten people. Quickly, you realize that once you have all these vehicles on board, you\u2019re running out of space for the people that operate them. We\u2019re trying to use our satellite connection to shore to take some of the engineering and operational expertise off the ship so that we can still operate these multiple vehicle systems.\u201d As it stood, the expedition carried 45 people aboard, from graduate students to professional engineers to the ship\u2019s crew.<\/p>\n<p>This leap ahead in ocean exploration was due to the ongoing support of NOAA Ocean Exploration. \u201cNOAA has the vision to not only fund ocean exploration but the development of the next generation tools and operational methods,\u201d Fahy said.<\/p>\n<div id='gallery-1' class='gallery galleryid-178844 gallery-columns-1 gallery-size-full'><figure class='gallery-item'>\n\t\t\t<div class='gallery-icon landscape'>\n\t\t\t\t<img loading=\"lazy\" decoding=\"async\" width=\"868\" height=\"600\" src=\"https:\/\/web.uri.edu\/gso\/wp-content\/uploads\/sites\/916\/AGSO_F22_GalleryOECI-MissionControl_868x600.jpg\" class=\"attachment-full size-full\" alt=\"\" aria-describedby=\"gallery-1-178847\" srcset=\"https:\/\/web.uri.edu\/gso\/wp-content\/uploads\/sites\/916\/AGSO_F22_GalleryOECI-MissionControl_868x600.jpg 868w, https:\/\/web.uri.edu\/gso\/wp-content\/uploads\/sites\/916\/AGSO_F22_GalleryOECI-MissionControl_868x600-300x207.jpg 300w, https:\/\/web.uri.edu\/gso\/wp-content\/uploads\/sites\/916\/AGSO_F22_GalleryOECI-MissionControl_868x600-768x531.jpg 768w, https:\/\/web.uri.edu\/gso\/wp-content\/uploads\/sites\/916\/AGSO_F22_GalleryOECI-MissionControl_868x600-364x252.jpg 364w, https:\/\/web.uri.edu\/gso\/wp-content\/uploads\/sites\/916\/AGSO_F22_GalleryOECI-MissionControl_868x600-500x346.jpg 500w\" sizes=\"auto, (max-width: 868px) 100vw, 868px\" \/>\n\t\t\t<\/div>\n\t\t\t\t<figcaption class='wp-caption-text gallery-caption' id='gallery-1-178847'>\n\t\t\t\tData feeds and commands are channeled through the operations center on board \nE\/V <em>Nautilus.<\/em>\n\t\t\t\t<\/figcaption><\/figure><figure class='gallery-item'>\n\t\t\t<div class='gallery-icon landscape'>\n\t\t\t\t<img loading=\"lazy\" decoding=\"async\" width=\"794\" height=\"600\" src=\"https:\/\/web.uri.edu\/gso\/wp-content\/uploads\/sites\/916\/AGSO_F22_GalleryOECI-Drix_794x600.jpg\" class=\"attachment-full size-full\" alt=\"\" aria-describedby=\"gallery-1-178845\" srcset=\"https:\/\/web.uri.edu\/gso\/wp-content\/uploads\/sites\/916\/AGSO_F22_GalleryOECI-Drix_794x600.jpg 794w, https:\/\/web.uri.edu\/gso\/wp-content\/uploads\/sites\/916\/AGSO_F22_GalleryOECI-Drix_794x600-300x227.jpg 300w, https:\/\/web.uri.edu\/gso\/wp-content\/uploads\/sites\/916\/AGSO_F22_GalleryOECI-Drix_794x600-768x580.jpg 768w, https:\/\/web.uri.edu\/gso\/wp-content\/uploads\/sites\/916\/AGSO_F22_GalleryOECI-Drix_794x600-364x275.jpg 364w, https:\/\/web.uri.edu\/gso\/wp-content\/uploads\/sites\/916\/AGSO_F22_GalleryOECI-Drix_794x600-500x378.jpg 500w\" sizes=\"auto, (max-width: 794px) 100vw, 794px\" \/>\n\t\t\t<\/div>\n\t\t\t\t<figcaption class='wp-caption-text gallery-caption' id='gallery-1-178845'>\n\t\t\t\tThe Autonomous Surface Vehicle (ASV) DriX\n\t\t\t\t<\/figcaption><\/figure><figure class='gallery-item'>\n\t\t\t<div class='gallery-icon landscape'>\n\t\t\t\t<img loading=\"lazy\" decoding=\"async\" width=\"875\" height=\"600\" src=\"https:\/\/web.uri.edu\/gso\/wp-content\/uploads\/sites\/916\/AGSO_F22_GalleryOECI-Mesobot_875x600.jpg\" class=\"attachment-full size-full\" alt=\"\" aria-describedby=\"gallery-1-178846\" srcset=\"https:\/\/web.uri.edu\/gso\/wp-content\/uploads\/sites\/916\/AGSO_F22_GalleryOECI-Mesobot_875x600.jpg 875w, https:\/\/web.uri.edu\/gso\/wp-content\/uploads\/sites\/916\/AGSO_F22_GalleryOECI-Mesobot_875x600-300x206.jpg 300w, https:\/\/web.uri.edu\/gso\/wp-content\/uploads\/sites\/916\/AGSO_F22_GalleryOECI-Mesobot_875x600-768x527.jpg 768w, https:\/\/web.uri.edu\/gso\/wp-content\/uploads\/sites\/916\/AGSO_F22_GalleryOECI-Mesobot_875x600-364x250.jpg 364w, https:\/\/web.uri.edu\/gso\/wp-content\/uploads\/sites\/916\/AGSO_F22_GalleryOECI-Mesobot_875x600-500x343.jpg 500w\" sizes=\"auto, (max-width: 875px) 100vw, 875px\" \/>\n\t\t\t<\/div>\n\t\t\t\t<figcaption class='wp-caption-text gallery-caption' id='gallery-1-178846'>\n\t\t\t\tThe Autonomous Underwater Vehicle (AUV) Mesobot\n\t\t\t\t<\/figcaption><\/figure><figure class='gallery-item'>\n\t\t\t<div class='gallery-icon landscape'>\n\t\t\t\t<img loading=\"lazy\" decoding=\"async\" width=\"870\" height=\"600\" src=\"https:\/\/web.uri.edu\/gso\/wp-content\/uploads\/sites\/916\/AGSO_F22_GalleryOECI-NUI_870x600.jpg\" class=\"attachment-full size-full\" alt=\"\" aria-describedby=\"gallery-1-178848\" srcset=\"https:\/\/web.uri.edu\/gso\/wp-content\/uploads\/sites\/916\/AGSO_F22_GalleryOECI-NUI_870x600.jpg 870w, https:\/\/web.uri.edu\/gso\/wp-content\/uploads\/sites\/916\/AGSO_F22_GalleryOECI-NUI_870x600-300x207.jpg 300w, https:\/\/web.uri.edu\/gso\/wp-content\/uploads\/sites\/916\/AGSO_F22_GalleryOECI-NUI_870x600-768x530.jpg 768w, https:\/\/web.uri.edu\/gso\/wp-content\/uploads\/sites\/916\/AGSO_F22_GalleryOECI-NUI_870x600-364x251.jpg 364w, https:\/\/web.uri.edu\/gso\/wp-content\/uploads\/sites\/916\/AGSO_F22_GalleryOECI-NUI_870x600-500x345.jpg 500w\" sizes=\"auto, (max-width: 870px) 100vw, 870px\" \/>\n\t\t\t<\/div>\n\t\t\t\t<figcaption class='wp-caption-text gallery-caption' id='gallery-1-178848'>\n\t\t\t\tThe Hybrid Remotely Operated Vehicle (HROV) Neruid Under Ice\n\t\t\t\t<\/figcaption><\/figure>\n\t\t<\/div>\n\n<p>The Ocean Exploration Trust provided the E\/V <em>Nautilus<\/em> and hosted teams from the University of New Hampshire\u2019s Center for Coastal and Ocean Mapping and Woods Hole Oceanographic Institution for this multi-robot collaboration. In just two weeks at sea the robots spent 210 hours in the water over the course of thirty dives. The three robots, DriX, Mesobot, and NUI were all put to the test, with E\/V <em>Nautilus<\/em> serving as the command center and host vessel.<\/p>\n<p>Soule explained why getting the vehicles to communicate with one another was an accomplishment. \u201cWe are operating within this extremely bandwidth-limited environment. You don\u2019t have Wi-Fi in the ocean, you don\u2019t have radio, you basically can send information via sound and over very short distances via light. And so you have to figure out how to extract the relevant information from one vehicle, distill it down to a kind of small message and send it to another vehicle. Plus, the vehicles must have the same kind of technology on them to send and receive messages.<\/p>\n<p>\u201cBecause we\u2019re working cooperatively, we can ensure that we have the correct hardware on each vehicle in order to communicate with each other to distill the information down to small messages,\u201d Soule said. \u201cWhat we\u2019ve done so far is we\u2019ve kept a human in the loop so the surface vehicle will send its information back to the ship. Experts will look at it and determine what it means. Then, they\u2019ll make small changes, retask it to another vehicle, and send that distilled information to the vehicle.\u201d<\/p>\n<p>\u201cRight now, we require humans in the loop to do that distillation, but where we\u2019re going in the future is to automate that process by using artificial intelligence and machine learning to essentially give more autonomy to the robots to decide what\u2019s important and how they should retask,\u201d Soule said.<\/p>\n<section class=\"cl-wrapper cl-quote-wrapper\"><div class=\"cl-quote  \"><div class=\"cl-quote-image\" style=\"background-image:url(https:\/\/web.uri.edu\/gso\/wp-content\/uploads\/sites\/916\/AGSO_F22_OECI-Soule_300x300.jpg)\" title=\"\"><\/div><blockquote>\u201cTogether, we made huge strides in how we can explore the ocean\u2014from mapping, to sampling, to vehicle-to-vehicle communication.\u201d<\/blockquote><cite>Adam Soule, Executive Director, OECI<\/cite><\/div><\/section>\n<p>Operating off Oahu, Hawaii, as a base, the scientists used the uncrewed surface vessel DriX, the hybrid remotely operated underwater vehicle Mesobot and hybrid ROV Nereid Under Ice (NUI) in the 16-day cruise. The team used DriX for mapping, along with using its marine broadband radio capabilities as a long-distance communications link that can reach up to 20 kilometers. This allowed the ship to move away from DriX and carry out its own missions.<\/p>\n<p>\u201cIt was really crawl, walk, run,\u201d Fahy said. \u201cWe began with just getting everything into the water safely and robots working individually. Then we paired the vehicles together and found the sweet spot of how they could collaborate and contribute.\u201d As success built upon success, the group decided to put all three vehicles to work attempting to answer a genuine scientific question.<\/p>\n<p>\u201cWe utilized a pressing question to give meaning to our technology demonstration. This had to be more than just a technology operation. We\u2019re being funded to explore and do science. These sorts of technologies are just the tools we use to conduct science.\u201d<\/p>\n<p>Eventually, mapping from DriX indicated the presence of a pinnacle rising 75 meters from the seafloor that was unique and worthy of exploration. Based on the DriX data, the team launched Mesobot and instructed it to head to the location, all the while with DriX circling the area at the surface. In examining their screens, the group noticed what looked like shimmering in the water, which indicated some change in water density. One of the sensors on Mesobot was a CTD (conductivity, temperature, and depth) that gave further evidence that something was there. Fahy and the group decided it was worth investigating. \u201cWe saw an anomaly in the conductivity of the water around the vehicle. We decided to explore not only the seabed with the NUI but the water column above and at the sea surface.\u201d<\/p>\n<p>\u201cThe excitement came when we could see anomalies and unique conditions in data from three of the vehicles. It turns out fresh water was flowing beneath the seafloor and up through this pinnacle, the sensors were picking up the density difference. While NUI was measuring water density, Mesobot was registering changes in fish behavior when they swam near the plume of fresh water. It was only because of our multiple vehicle capability that we were able to document the effect of this freshwater plume throughout the water column,\u201d Fahy said.<\/p>\n<p>\u201cTogether, we made huge strides in how we can explore the ocean\u2014from mapping, to sampling, to vehicle-to-vehicle communication,\u201d Soule said.<\/p>\n<p>Soule too sees the mission as a positive. \u201cSuccess is not necessarily when you\u2019re trying to do the things that we were trying to do that are challenging and advancing the technology. Success isn\u2019t necessarily measured on a cruise. The development of these technologies happens in steps, and over years, not weeks. But with this particular cruise, when we got to the final day, and could deploy all three systems simultaneously, one at the surface, one in mid-water, and one at the sea floor and have them exploring a feature in the ocean from the top that felt very successful to me. That felt like we had arrived at a landing on the staircase to the future and could see the path ahead.\u201d<\/p>\n<p>Next year, the expedition will kick it up a notch with more challenging conditions. With the vehicles worth roughly one-half million dollars to $2 million apiece, the team walks the line between being overly cautious about the conditions they subject the vehicles to and pushing too hard. \u201cWe don\u2019t put the vehicles in harm\u2019s way to advance them,\u201d said Soule. It\u2019s not that we will only do things that we are sure will succeed. We will take risks in order to push the technology forward. But within that context of being as prepared as we can for any eventuality.\u201d<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/web.uri.edu\/gso\/wp-content\/uploads\/sites\/916\/AGSO_F22_OECI-OpsTeamWatches_800x355.jpg\" alt=\"\" width=\"800\" height=\"355\" class=\"alignleft size-full wp-image-178851\" srcset=\"https:\/\/web.uri.edu\/gso\/wp-content\/uploads\/sites\/916\/AGSO_F22_OECI-OpsTeamWatches_800x355.jpg 800w, https:\/\/web.uri.edu\/gso\/wp-content\/uploads\/sites\/916\/AGSO_F22_OECI-OpsTeamWatches_800x355-300x133.jpg 300w, https:\/\/web.uri.edu\/gso\/wp-content\/uploads\/sites\/916\/AGSO_F22_OECI-OpsTeamWatches_800x355-768x341.jpg 768w, https:\/\/web.uri.edu\/gso\/wp-content\/uploads\/sites\/916\/AGSO_F22_OECI-OpsTeamWatches_800x355-364x162.jpg 364w, https:\/\/web.uri.edu\/gso\/wp-content\/uploads\/sites\/916\/AGSO_F22_OECI-OpsTeamWatches_800x355-500x222.jpg 500w\" sizes=\"auto, (max-width: 800px) 100vw, 800px\" \/><\/p>\n<p>\u201cIt\u2019s not going to be in the relatively sheltered waters near Hawaii,\u201d Fahy said. \u201cWe\u2019ll be in an unexplored part of the ocean prepared for our robots to make the next big exploration discovery!\u201d<\/p>\n","protected":false},"excerpt":{"rendered":"<p>By Hugh Markey; photos courtesy of Ocean Exploration Trust Scientists, researchers and engineers aboard exploration vessel (E\/V) Nautilus successfully dem\u00adonstrated that autonomous uncrewed systems can work collabor\u00adatively during a scientific mission. This latest development in technologies and methods will prove to be a \u201cforce-multiplier\u201d for future ocean exploration. Expedition leader Jason Fahy from URI\u2019s GSO [&hellip;]<\/p>\n","protected":false},"author":2120,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":"","_links_to":"","_links_to_target":""},"categories":[7,1987],"tags":[],"class_list":["post-178844","post","type-post","status-publish","format-standard","hentry","category-aboard-gso","category-publications"],"acf":[],"_links":{"self":[{"href":"https:\/\/web.uri.edu\/gso\/wp-json\/wp\/v2\/posts\/178844","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/web.uri.edu\/gso\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/web.uri.edu\/gso\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/web.uri.edu\/gso\/wp-json\/wp\/v2\/users\/2120"}],"replies":[{"embeddable":true,"href":"https:\/\/web.uri.edu\/gso\/wp-json\/wp\/v2\/comments?post=178844"}],"version-history":[{"count":5,"href":"https:\/\/web.uri.edu\/gso\/wp-json\/wp\/v2\/posts\/178844\/revisions"}],"predecessor-version":[{"id":178861,"href":"https:\/\/web.uri.edu\/gso\/wp-json\/wp\/v2\/posts\/178844\/revisions\/178861"}],"wp:attachment":[{"href":"https:\/\/web.uri.edu\/gso\/wp-json\/wp\/v2\/media?parent=178844"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/web.uri.edu\/gso\/wp-json\/wp\/v2\/categories?post=178844"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/web.uri.edu\/gso\/wp-json\/wp\/v2\/tags?post=178844"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}