AEGIS autonomous targeting for ChemCam on Mars Science Laboratory: Deployment and results of initial science team use

Autonomous robotics is driving Perseverance rover's progress on Mars

NASA's Perseverance rover uses robotic autonomy to achieve its mission goals on Mars. Its self-driving autonomous navigation system (AutoNav) has been used to evaluate 88% of the 17.7-kilometer distance traveled during its first Mars year of operation. Previously, the maximum total autonomous distance evaluated was 2.4 kilometers by the Opportunity rover during its 14-year lifetime. AutoNav has set multiple planetary rover records, including the greatest distance driven without human review (699.9 meters) and the greatest single-day drive distance (347.7 meters). The Autonomous Exploration for Gathering Increased Science (AEGIS) system analyzes wide-angle imagery onboard to autonomously select targets for observations by the SuperCam instrument, a multimode sensor suite capable of millimeter-scale geochemical and mineralogical analysis. AEGIS enables observations of scientifically interesting targets during or immediately after long drives without the need for ground communication. OnBoard Planner (OBP) is a scheduling capability planned for operational use in September 2023 that has the potential to reduce energy usage by up to 20% and complete drive and arm-contact science campaigns in 25% fewer days on Mars. This paper presents an overview of the AutoNav, AEGIS, and OBP capabilities used on Perseverance.

Science Autonomy for Ocean Worlds Astrobiology: A Perspective

Astrobiology missions to ocean worlds in our solar system must overcome both scientific and technological challenges due to extreme temperature and radiation conditions, long communication times, and limited bandwidth. While such tools could not replace ground-based analysis by science and engineering teams, machine learning algorithms could enhance the science return of these missions through development of autonomous science capabilities. Examples of science autonomy include onboard data analysis and subsequent instrument optimization, data prioritization (for transmission), and real-time decision-making based on data analysis. Similar advances could be made to develop streamlined data processing software for rapid ground-based analyses. Here we discuss several ways machine learning and autonomy could be used for astrobiology missions, including landing site selection, prioritization and targeting of samples, classification of "features" (e.g., proposed biosignatures) and novelties (uncharacterized, "new" features, which may be of most interest to agnostic astrobiological investigations), and data transmission.

Squeezing Data from a Rock: Machine Learning for Martian Science

Data analysis methods have scarcely kept pace with the rapid increase in Earth observations, spurring the development of novel algorithms, storage methods, and computational techniques. For scientists interested in Mars, the problem is always the same: there is simultaneously never enough of the right data and an overwhelming amount of data in total. Finding sufficient data needles in a haystack to test a hypothesis requires hours of manual data screening, and more needles and hay are added constantly. To date, the vast majority of Martian research has been focused on either one-off local/regional studies or on hugely time-consuming manual global studies. Machine learning in its numerous forms can be helpful for future such work. Machine learning has the potential to help map and classify a large variety of both features and properties on the surface of Mars and to aid in the planning and execution of future missions. Here, we outline the current extent of machine learning as applied to Mars, summarize why machine learning should be an important tool for planetary geomorphology in particular, and suggest numerous research avenues and funding priorities for future efforts. We conclude that: (1) moving toward methods that require less human input (i.e., self- or semi-supervised) is an important paradigm shift for Martian applications, (2) new robust methods using generative adversarial networks to generate synthetic high-resolution digital terrain models represent an exciting new avenue for Martian geomorphologists, (3) more effort and money must be directed toward developing standardized datasets and benchmark tests, and (4) the community needs a large-scale, generalized, and programmatically accessible geographic information system (GIS).

Mission Overview and Scientific Contributions from the Mars Science Laboratory Curiosity Rover After Eight Years of Surface Operations

NASA's Mars Science Laboratory mission, with its Curiosity rover, has been exploring Gale crater (5.4° S, 137.8° E) since 2012 with the goal of assessing the potential of Mars to support life. The mission has compiled compelling evidence that the crater basin accumulated sediment transported by marginal rivers into lakes that likely persisted for millions of years approximately 3.6 Ga ago in the early Hesperian. Geochemical and mineralogical assessments indicate that environmental conditions within this timeframe would have been suitable for sustaining life, if it ever were present. Fluids simultaneously circulated in the subsurface and likely existed through the dry phases of lake bed exposure and aeolian deposition, conceivably creating a continuously habitable subsurface environment that persisted to less than 3 Ga in the early Amazonian. A diversity of organic molecules has been preserved, though degraded, with evidence for more complex precursors. Solid samples show highly variable isotopic abundances of sulfur, chlorine, and carbon. In situ studies of modern wind-driven sediment transport and multiple large and active aeolian deposits have led to advances in understanding bedform development and the initiation of saltation. Investigation of the modern atmosphere and environment has improved constraints on the timing and magnitude of atmospheric loss, revealed the presence of methane and the crater's influence on local meteorology, and provided measurements of high-energy radiation at Mars' surface in preparation for future crewed missions. Rover systems and science instruments remain capable of addressing all key scientific objectives. Emphases on advance planning, flexibility, operations support work, and team culture have allowed the mission team to maintain a high level of productivity in spite of declining rover power and funding.

SUPPLEMENTARY INFORMATION

The online version contains supplementary material available at 10.1007/s11214-022-00882-7.

A 2-year locomotive exploration and scientific investigation of the lunar farside by the Yutu-2 rover

The lunar nearside has been investigated by many uncrewed and crewed missions, but the farside of the Moon remains poorly known. Lunar farside exploration is challenging because maneuvering rovers with efficient locomotion in harsh extraterrestrial environment is necessary to explore geological characteristics of scientific interest. Chang'E-4 mission successfully targeted the Moon's farside and deployed a teleoperated rover (Yutu-2) to explore inside the Von Kármán crater, conveying rich information regarding regolith, craters, and rocks. Here, we report mobile exploration on the lunar farside with Yutu-2 over the initial 2 years. During its journey, Yutu-2 has experienced varying degrees of mild slip and skid, indicating that the terrain is relatively flat at large scales but scattered with local gentle slopes. Cloddy soil sticking on its wheels implies a greater cohesion of the lunar soil than encountered at other lunar landing sites. Further identification results indicate that the regolith resembles dry sand and sandy loam on Earth in bearing properties, demonstrating greater bearing strength than that identified during the Apollo missions. In sharp contrast to the sparsity of rocks along the traverse route, small fresh craters with unilateral moldable ejecta are abundant, and some of them contain high-reflectance materials at the bottom, suggestive of secondary impact events. These findings hint at notable differences in the surface geology between the lunar farside and nearside. Experience gained with Yutu-2 improves the understanding of the farside of the Moon, which, in return, may lead to locomotion with improved efficiency and larger range.

Towards global flood mapping onboard low cost satellites with machine learning

Spaceborne Earth observation is a key technology for flood response, offering valuable information to decision makers on the ground. Very large constellations of small, nano satellites- 'CubeSats' are a promising solution to reduce revisit time in disaster areas from days to hours. However, data transmission to ground receivers is limited by constraints on power and bandwidth of CubeSats. Onboard processing offers a solution to decrease the amount of data to transmit by reducing large sensor images to smaller data products. The ESA's recent PhiSat-1 mission aims to facilitate the demonstration of this concept, providing the hardware capability to perform onboard processing by including a power-constrained machine learning accelerator and the software to run custom applications. This work demonstrates a flood segmentation algorithm that produces flood masks to be transmitted instead of the raw images, while running efficiently on the accelerator aboard the PhiSat-1. Our models are trained on WorldFloods: a newly compiled dataset of 119 globally verified flooding events from disaster response organizations, which we make available in a common format. We test the system on independent locations, demonstrating that it produces fast and accurate segmentation masks on the hardware accelerator, acting as a proof of concept for this approach.

The SuperCam Instrument Suite on the NASA Mars 2020 Rover: Body Unit and Combined System Tests

The SuperCam instrument suite provides the Mars 2020 rover, Perseverance, with a number of versatile remote-sensing techniques that can be used at long distance as well as within the robotic-arm workspace. These include laser-induced breakdown spectroscopy (LIBS), remote time-resolved Raman and luminescence spectroscopies, and visible and infrared (VISIR; separately referred to as VIS and IR) reflectance spectroscopy. A remote micro-imager (RMI) provides high-resolution color context imaging, and a microphone can be used as a stand-alone tool for environmental studies or to determine physical properties of rocks and soils from shock waves of laser-produced plasmas. SuperCam is built in three parts: The mast unit (MU), consisting of the laser, telescope, RMI, IR spectrometer, and associated electronics, is described in a companion paper. The on-board calibration targets are described in another companion paper. Here we describe SuperCam's body unit (BU) and testing of the integrated instrument. The BU, mounted inside the rover body, receives light from the MU via a 5.8 m optical fiber. The light is split into three wavelength bands by a demultiplexer, and is routed via fiber bundles to three optical spectrometers, two of which (UV and violet; 245-340 and 385-465 nm) are crossed Czerny-Turner reflection spectrometers, nearly identical to their counterparts on ChemCam. The third is a high-efficiency transmission spectrometer containing an optical intensifier capable of gating exposures to 100 ns or longer, with variable delay times relative to the laser pulse. This spectrometer covers 535-853 nm ( 105 - 7070 cm - 1 Raman shift relative to the 532 nm green laser beam) with 12 cm - 1 full-width at half-maximum peak resolution in the Raman fingerprint region. The BU electronics boards interface with the rover and control the instrument, returning data to the rover. Thermal systems maintain a warm temperature during cruise to Mars to avoid contamination on the optics, and cool the detectors during operations on Mars. Results obtained with the integrated instrument demonstrate its capabilities for LIBS, for which a library of 332 standards was developed. Examples of Raman and VISIR spectroscopy are shown, demonstrating clear mineral identification with both techniques. Luminescence spectra demonstrate the utility of having both spectral and temporal dimensions. Finally, RMI and microphone tests on the rover demonstrate the capabilities of these subsystems as well.

Origin and composition of three heterolithic boulder- and cobble-bearing deposits overlying the Murray and Stimson formations, Gale Crater, Mars

Heterolithic, boulder-containing, pebble-strewn surfaces occur along the lower slopes of Aeolis Mons ("Mt. Sharp") in Gale crater, Mars. They were observed in HiRISE images acquired from orbit prior to the landing of the Curiosity rover. The rover was used to investigate three of these units named Blackfoot, Brandberg, and Bimbe between sols 1099 and 1410. These unconsolidated units overlie the lower Murray formation that forms the base of Mt. Sharp, and consist of pebbles, cobbles and boulders. Blackfoot also overlies portions of the Stimson formation, which consists of eolian sandstone that is understood to significantly postdate the dominantly lacustrine deposition of the Murray formation. Blackfoot is elliptical in shape (62 × 26 m), while Brandberg is nearly circular (50 × 55 m), and Bimbe is irregular in shape, covering about ten times the area of the other two. The largest boulders are 1.5-2.5 m in size and are interpreted to be sandstones. As seen from orbit, some boulders are light-toned and others are dark-toned. Rover-based observations show that both have the same gray appearance from the ground and their apparently different albedos in orbital observations result from relatively flat sky-facing surfaces. Chemical observations show that two clasts of fine sandstone at Bimbe have similar compositions and morphologies to nine ChemCam targets observed early in the mission, near Yellowknife Bay, including the Bathurst Inlet outcrop, and to at least one target (Pyramid Hills, Sol 692) and possibly a cap rock unit just north of Hidden Valley, locations that are several kilometers apart in distance and tens of meters in elevation. These findings may suggest the earlier existence of draping strata, like the Stimson formation, that would have overlain the current surface from Bimbe to Yellowknife Bay. Compositionally these extinct strata could be related to the Siccar Point group to which the Stimson formation belongs. Dark, massive sandstone blocks at Bimbe are chemically distinct from blocks of similar morphology at Bradbury Rise, except for a single float block, Oscar (Sol 516). Conglomerates observed along a low, sinuous ridge at Bimbe consist of matrix and clasts with compositions similar to the Stimson formation, suggesting that stream beds likely existed nearly contemporaneously with the dunes that eventually formed the Stimson formation, or that they had the same source material. In either case, they represent a later pulse of fluvial activity relative to the lakes associated with the Murray formation. These three units may be local remnants of infilled impact craters (especially circular-shaped Brandberg), decayed buttes, patches of unconsolidated fluvial deposits, or residual mass-movement debris. Their incorporation of Stimson and Murray rocks, the lack of lithification, and appearance of being erosional remnants suggest that they record erosion and deposition events that post-date the exposure of the Stimson formation.

Exo-Ocean Exploration with Deep-Sea Sensor and Platform Technologies

One of Saturn's largest moons, Enceladus, possesses a vast extraterrestrial ocean (i.e., exo-ocean) that is increasingly becoming the hotspot of future research initiatives dedicated to the exploration of putative life. Here, a new bio-exploration concept design for Enceladus' exo-ocean is proposed, focusing on the potential presence of organisms across a wide range of sizes (i.e., from uni- to multicellular and animal-like), according to state-of-the-art sensor and robotic platform technologies used in terrestrial deep-sea research. In particular, we focus on combined direct and indirect life-detection capabilities, based on optoacoustic imaging and passive acoustics, as well as molecular approaches. Such biologically oriented sampling can be accompanied by concomitant geochemical and oceanographic measurements to provide data relevant to exo-ocean exploration and understanding. Finally, we describe how this multidisciplinary monitoring approach is currently enabled in terrestrial oceans through cabled (fixed) observatories and their related mobile multiparametric platforms (i.e., Autonomous Underwater and Remotely Operated Vehicles, as well as crawlers, rovers, and biomimetic robots) and how their modified design can be used for exo-ocean exploration.

Comparison of novelty detection methods for multispectral images in rover-based planetary exploration missions

Science teams for rover-based planetary exploration missions like the Mars Science Laboratory Curiosity rover have limited time for analyzing new data before making decisions about follow-up observations. There is a need for systems that can rapidly and intelligently extract information from planetary instrument datasets and focus attention on the most promising or novel observations. Several novelty detection methods have been explored in prior work for three-channel color images and non-image datasets, but few have considered multispectral or hyperspectral image datasets for the purpose of scientific discovery. We compared the performance of four novelty detection methods—Reed Xiaoli (RX) detectors, principal component analysis (PCA), autoencoders, and generative adversarial networks (GANs)—and the ability of each method to provide explanatory visualizations to help scientists understand and trust predictions made by the system. We show that pixel-wise RX and autoencoders trained with structural similarity (SSIM) loss can detect morphological novelties that are not detected by PCA, GANs, and mean squared error autoencoders, but that the latter methods are better suited for detecting spectral novelties—i.e., the best method for a given setting depends on the type of novelties that are sought. Additionally, we find that autoencoders provide the most useful explanatory visualizations for enabling users to understand and trust model detections, and that existing GAN approaches to novelty detection may be limited in this respect.

Spatial Spectroscopic Models for Remote Exploration

Ancient hydrothermal systems are a high-priority target for a future Mars sample return mission because they contain energy sources for microbes and can preserve organic materials (Farmer, 2000 ; MEPAG Next Decade Science Analysis Group, 2008 ; McLennan et al., 2012 ; Michalski et al., 2017 ). Characterizing these large, heterogeneous systems with a remote explorer is difficult due to communications bandwidth and latency; such a mission will require significant advances in spacecraft autonomy. Science autonomy uses intelligent sensor platforms that analyze data in real-time, setting measurement and downlink priorities to provide the best information toward investigation goals. Such automation must relate abstract science hypotheses to the measurable quantities available to the robot. This study captures these relationships by formalizing traditional "science traceability matrices" into probabilistic models. This permits experimental design techniques to optimize future measurements and maximize information value toward the investigation objectives, directing remote explorers that respond appropriately to new data. Such models are a rich new language for commanding informed robotic decision making in physically grounded terms. We apply these models to quantify the information content of different rover traverses providing profiling spectroscopy of Cuprite Hills, Nevada. We also develop two methods of representing spatial correlations using human-defined maps and remote sensing data. Model unit classifications are broadly consistent with prior maps of the site's alteration mineralogy, indicating that the model has successfully represented critical spatial and mineralogical relationships at Cuprite. Key Words: Autonomous science-Imaging spectroscopy-Alteration mineralogy-Field geology-Cuprite-AVIRIS-NG-Robotic exploration. Astrobiology 18, 934-954.

Femtosecond laser induced breakdown spectroscopy based standoff detection of explosives and discrimination using principal component analysis

We report the standoff (up to ~2 m) and remote (~8.5 m) detection of novel high energy materials/explosive molecules (Nitroimidazoles and Nitropyrazoles) using the technique of femtosecond laser induced breakdown spectroscopy (LIBS). We utilized two different collection systems (a) ME-OCT-0007 (commercially available) and (b) Schmidt-Cassegrain telescope for these experiments. In conjunction with LIBS data, principal component analysis was employed to discriminate/classify the explosives and the obtained results in both configurations are compared. Different aspects influencing the LIBS signal strength at far distances such as fluence at target, efficiency of collection system etc. are discussed.