{"id":621169,"date":"2024-03-12T07:05:48","date_gmt":"2024-03-12T11:05:48","guid":{"rendered":"https:\/\/www.nasa.gov\/?p=621169"},"modified":"2024-03-12T07:05:49","modified_gmt":"2024-03-12T11:05:49","slug":"understanding-risk-artificial-intelligence-and-improving-software-quality","status":"publish","type":"post","link":"https:\/\/www.nasa.gov\/centers-and-facilities\/nesc\/understanding-risk-artificial-intelligence-and-improving-software-quality\/","title":{"rendered":"Understanding Risk, Artificial Intelligence, and Improving Software Quality"},"content":{"rendered":"\n<p>The software discipline has broad involvement across each of the NASA Mission Directorates. Some recent discipline focus and development areas are highlighted below, along with a look at the Software Technical Discipline Team’s (TDT) approach to evolving discipline best practices toward the future.<\/p>\n\n\n\n<p><\/p>\n\n\n\n<p><strong>Understanding Automation Risk<\/strong><\/p>\n\n\n\n<p><\/p>\n\n\n\n<p>Software creates automation. Reliance on that automation is increasing the amount of software in NASA programs. This year, the software team examined historical software incidents in aerospace to characterize how, why, and where software or automation is mostly likely to fail. The goal is to better engineer software to minimize the risk of errors, improve software processes, and better architect software for resilience to errors (or improve fault-tolerance should errors occur).<\/p>\n\n\n\n<p class=\"has-text-align-center\"><img loading=\"lazy\" decoding=\"async\" width=\"1869\" height=\"1427\" class=\"wp-image-630520\" style=\"width: 500px\" src=\"https:\/\/www.nasa.gov\/wp-content\/uploads\/2024\/03\/techup2023-pg50-51-art1.png\" alt=\"\" srcset=\"https:\/\/www.nasa.gov\/wp-content\/uploads\/2024\/03\/techup2023-pg50-51-art1.png 1869w, https:\/\/www.nasa.gov\/wp-content\/uploads\/2024\/03\/techup2023-pg50-51-art1.png?resize=300,229 300w, https:\/\/www.nasa.gov\/wp-content\/uploads\/2024\/03\/techup2023-pg50-51-art1.png?resize=768,586 768w, https:\/\/www.nasa.gov\/wp-content\/uploads\/2024\/03\/techup2023-pg50-51-art1.png?resize=1024,782 1024w, https:\/\/www.nasa.gov\/wp-content\/uploads\/2024\/03\/techup2023-pg50-51-art1.png?resize=1536,1173 1536w, https:\/\/www.nasa.gov\/wp-content\/uploads\/2024\/03\/techup2023-pg50-51-art1.png?resize=400,305 400w, https:\/\/www.nasa.gov\/wp-content\/uploads\/2024\/03\/techup2023-pg50-51-art1.png?resize=600,458 600w, https:\/\/www.nasa.gov\/wp-content\/uploads\/2024\/03\/techup2023-pg50-51-art1.png?resize=900,687 900w, https:\/\/www.nasa.gov\/wp-content\/uploads\/2024\/03\/techup2023-pg50-51-art1.png?resize=1200,916 1200w\" sizes=\"(max-width: 1869px) 100vw, 1869px\" \/><\/p>\n\n\n\n<p><\/p>\n\n\n\n<p>Some key findings shown in the above charts, indicate that software more often does the wrong thing rather than just crash. Rebooting was found to be ineffective when software behaves erroneously. Unexpected behavior was mostly attributed to the code or logic itself, and about half of those instances were the result of missing software\u2014software not present due to unanticipated situations or missing requirements. This may indicate that even fully tested software is exposed to this significant class of error. Data misconfiguration was a sizeable factor that continues to grow with the advent of more modern data-driven systems. A final subjective category assessed was \u201cunknown unknowns\u201d\u2014things that could not have been reasonably anticipated. These accounted for 19% of software incidents studied.<\/p>\n\n\n\n<p><\/p>\n\n\n\n<p>The software team is using and sharing these findings to improve best practices. More emphasis is being placed on the importance of complete requirements, off-nominal test campaigns, and \u201ctest as you fly\u201d using real hardware in the loop. When designing systems for fault tolerance, more consideration should be given to detecting and correcting for erroneous behavior versus just checking for a crash. Less confidence should be placed on rebooting as an effective recovery strategy. Backup strategies for automations should be employed for critical applications\u2014considering the historic prevalence of absent software and unknown unknowns. More information can be found in NASA\/TP-20230012154, Software Error Incident Categorizations in Aerospace.<\/p>\n\n\n\n<p><\/p>\n\n\n\n<p><strong>Employing AI and Machine Learning Techniques<\/strong><\/p>\n\n\n\n<p><\/p>\n\n\n\n<p>The rise of artificial intelligence (AI) and machine learning (ML) techniques has allowed NASA to examine data in new ways that were not previously possible. While NASA has been employing autonomy since its inception, AI\/ML techniques provide teams the ability to expand the use of autonomy outside of previous bounds. The Agency has been working on AI ethics frameworks and examining standards, procedures, and practices, taking security implications into account. While AI\/ML generally uses nondeterministic statistical algorithms that currently limit its use in safety-critical flight applications, it is used by NASA in more than 400 AI\/ML projects aiding research and science. The Agency also uses AI\/ML Communities of Practice for sharing knowledge across the centers. The TDT surveyed AI\/ML work across the Agency and summarized it for trends and lessons.<\/p>\n\n\n\n<p><\/p>\n\n\n\n<p>Common usages of AI\/ML include image recognition and identification. NASA Earth science missions use AI\/ML to identify marine debris, measure cloud thickness, and identify wildfire smoke (examples are shown in the satellite images below). This reduces the workload on personnel. There are many applications of AI\/ML being used to predict atmospheric physics. One example is hurricane track and intensity prediction. Another example is predicting planetary boundary layer thickness and comparing it against measurements, and those predictions are being fused with live data to improve the performance over previous boundary layer models.<\/p>\n\n\n<div id=\"\" class=\"hds-media hds-module wp-block-image\"><div class=\"margin-left-auto margin-right-auto nasa-block-align-inline\"><div class=\"hds-media-wrapper margin-left-auto margin-right-auto\"><figure class=\"hds-media-inner hds-cover-wrapper hds-media-ratio-fit \"><a href=\"https:\/\/www.nasa.gov\/wp-content\/uploads\/2024\/02\/techup2023-pg50-51-art2.png\"><img fetchpriority=\"high\" decoding=\"async\" width=\"1815\" height=\"383\" src=\"https:\/\/www.nasa.gov\/wp-content\/uploads\/2024\/02\/techup2023-pg50-51-art2.png?w=1815\" class=\"attachment-2048x2048 size-2048x2048\" alt=\"\" style=\"transform: scale(1); transform-origin: 50% 50%; object-position: 50% 50%; object-fit: cover;\" block_context=\"nasa-block\" srcset=\"https:\/\/www.nasa.gov\/wp-content\/uploads\/2024\/02\/techup2023-pg50-51-art2.png 1815w, https:\/\/www.nasa.gov\/wp-content\/uploads\/2024\/02\/techup2023-pg50-51-art2.png?resize=300,63 300w, https:\/\/www.nasa.gov\/wp-content\/uploads\/2024\/02\/techup2023-pg50-51-art2.png?resize=768,162 768w, https:\/\/www.nasa.gov\/wp-content\/uploads\/2024\/02\/techup2023-pg50-51-art2.png?resize=1024,216 1024w, https:\/\/www.nasa.gov\/wp-content\/uploads\/2024\/02\/techup2023-pg50-51-art2.png?resize=1536,324 1536w, https:\/\/www.nasa.gov\/wp-content\/uploads\/2024\/02\/techup2023-pg50-51-art2.png?resize=400,84 400w, https:\/\/www.nasa.gov\/wp-content\/uploads\/2024\/02\/techup2023-pg50-51-art2.png?resize=600,127 600w, https:\/\/www.nasa.gov\/wp-content\/uploads\/2024\/02\/techup2023-pg50-51-art2.png?resize=900,190 900w, https:\/\/www.nasa.gov\/wp-content\/uploads\/2024\/02\/techup2023-pg50-51-art2.png?resize=1200,253 1200w\" sizes=\"(max-width: 1815px) 100vw, 1815px\" loading=\"eager\" \/><\/a><\/figure><figcaption class=\"hds-caption padding-y-2\"><div class=\"hds-caption-text p-sm margin-0\">Examples of how NASA uses AI\/ML. Satellite images of clouds with estimation of cloud thickness (left) and wildfire detection (right).<\/div><\/figcaption><\/div><\/div><\/div>\n\n<div id=\"\" class=\"hds-media hds-module wp-block-image\"><div class=\"margin-left-auto margin-right-auto nasa-block-align-inline\"><div class=\"hds-media-wrapper margin-left-auto margin-right-auto\"><figure class=\"hds-media-inner hds-cover-wrapper hds-media-ratio-fit \"><a href=\"https:\/\/www.nasa.gov\/wp-content\/uploads\/2024\/02\/techup2023-pg50-51-art3.png\"><img loading=\"lazy\" decoding=\"async\" width=\"2048\" height=\"1201\" src=\"https:\/\/www.nasa.gov\/wp-content\/uploads\/2024\/02\/techup2023-pg50-51-art3.png?w=2048\" class=\"attachment-2048x2048 size-2048x2048\" alt=\"\" style=\"transform: scale(1); transform-origin: 50% 50%; object-position: 50% 50%; object-fit: cover;\" block_context=\"nasa-block\" srcset=\"https:\/\/www.nasa.gov\/wp-content\/uploads\/2024\/02\/techup2023-pg50-51-art3.png 2345w, https:\/\/www.nasa.gov\/wp-content\/uploads\/2024\/02\/techup2023-pg50-51-art3.png?resize=300,176 300w, https:\/\/www.nasa.gov\/wp-content\/uploads\/2024\/02\/techup2023-pg50-51-art3.png?resize=768,450 768w, https:\/\/www.nasa.gov\/wp-content\/uploads\/2024\/02\/techup2023-pg50-51-art3.png?resize=1024,600 1024w, https:\/\/www.nasa.gov\/wp-content\/uploads\/2024\/02\/techup2023-pg50-51-art3.png?resize=1536,901 1536w, https:\/\/www.nasa.gov\/wp-content\/uploads\/2024\/02\/techup2023-pg50-51-art3.png?resize=2048,1201 2048w, https:\/\/www.nasa.gov\/wp-content\/uploads\/2024\/02\/techup2023-pg50-51-art3.png?resize=400,235 400w, https:\/\/www.nasa.gov\/wp-content\/uploads\/2024\/02\/techup2023-pg50-51-art3.png?resize=600,352 600w, https:\/\/www.nasa.gov\/wp-content\/uploads\/2024\/02\/techup2023-pg50-51-art3.png?resize=900,528 900w, https:\/\/www.nasa.gov\/wp-content\/uploads\/2024\/02\/techup2023-pg50-51-art3.png?resize=1200,704 1200w, https:\/\/www.nasa.gov\/wp-content\/uploads\/2024\/02\/techup2023-pg50-51-art3.png?resize=2000,1173 2000w\" sizes=\"(max-width: 2048px) 100vw, 2048px\" \/><\/a><\/figure><figcaption class=\"hds-caption padding-y-2\"><div class=\"hds-caption-text p-sm margin-0\">NASA-HDBK-2203, NASA Software Engineering and Assurance Handbook (https:\/\/swehb.nasa.gov)<\/div><\/figcaption><\/div><\/div><\/div>\n\n\n<p><strong>The Code Analysis Pipeline: Static Analysis Tool for IV&V and Software Quality Improvement<\/strong><\/p>\n\n\n\n<p>The Code Analysis Pipeline (CAP) is an open-source tool architecture that supports software development and assurance activities, improving overall software quality. The Independent Verification and Validation (IV&V) Program is using CAP to support software assurance on the Human Landing System, Gateway, Exploration Ground Systems, Orion, and Roman. CAP supports the configuration and automated execution of multiple static code analysis tools to identify potential code defects, generate code metrics that indicate potential areas of quality concern (e.g., cyclomatic complexity), and execute any other tool that analyzes or processes source code. The TDT is focused on integrating Modified Condition\/Decision Coverage analysis support for coverage testing. Results from tools are consolidated into a central database and presented in context through a user interface that supports review, query, reporting, and analysis of results as the code matures.<\/p>\n\n\n\n<p><\/p>\n\n\n\n<p>The tool architecture is based on an industry standard DevOps approach for continuous building of source code and running of tools. CAP integrates with GitHub for source code control, uses Jenkins to support automation of analysis builds, and leverages Docker to create standard and custom build environments that support unique mission needs and use cases.<\/p>\n\n\n\n<p><\/p>\n\n\n\n<p><strong>Improving Software Process & Sharing Best Practices<\/strong><\/p>\n\n\n\n<p><\/p>\n\n\n\n<p>The TDT has captured the best practice knowledge from across the centers in NPR 7150.2, NASA Software Engineering Requirements, and NASA-HDBK-2203, NASA Software Engineering and Assurance Handbook (https:\/\/swehb.nasa.gov.) Two APPEL training classes have been developed and shared with several organizations to give them the foundations in the NPR and software engineering management. The TDT established several subteams to help programs\/projects as they tackle software architecture, project management, requirements, cybersecurity, testing and verification, and programmable logic controllers. Many of these teams have developed guidance and best practices, which are documented in NASA-HDBK-2203 and on the NASA Engineering Network.<\/p>\n\n\n\n<p><\/p>\n\n\n\n<p>NPR 7150.2 and the handbook outline best practices over the full lifecycle for all NASA software. This includes requirements development, architecture, design, implementation, and verification. Also covered, and equally important, are the supporting activities\/functions that improve quality, including software assurance, safety configuration management, reuse, and software acquisition. Rationale and guidance for the requirements are addressed in the handbook that is internally and externally accessible and regularly updated as new information, tools, and techniques are found and used.<\/p>\n\n\n\n<p><\/p>\n\n\n\n<p>The Software TDT deputies train software engineers, systems engineers, chief engineers, and project managers on the NPR requirements and their role in ensuring these requirements are implemented across NASA centers. Additionally, the TDT deputies train software technical leads on many of the advanced management aspects of a software engineering effort, including planning, cost estimating, negotiating, and handling change management.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The software discipline has broad involvement across each of the NASA Mission Directorates. Some recent discipline focus and development areas are highlighted below, along with a look at the Software Technical Discipline Team’s (TDT) approach to evolving discipline best practices toward the future. Understanding Automation Risk Software creates automation. Reliance on that automation is increasing […]<\/p>\n","protected":false},"author":275,"featured_media":630520,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"nasa_hds_core_meta_l10n":"en-US","nasa_hds_core_meta_article_editor":"","nasa_hds_core_meta_article_contacts":[],"nasa_hds_core_meta_article_topic":"","nasa_hds_core_meta_linked_locations":[],"nasa_hds_core_meta_article_related_articles":[],"hds_migrate_meta_pr_release_id":"","hds_migrate_meta_pr_release_type":"","nasa_hds_core_meta_location_x":"","nasa_hds_core_meta_location_y":"","nasa_hds_core_meta_gallery_images":[],"footnotes":""},"categories":[2866],"news-tags":[],"internal-terms":[],"coauthors":[10851],"parsely":{"version":"1.1.0","meta":{"@context":"https:\/\/schema.org","@type":"NewsArticle","headline":"Understanding Risk, Artificial Intelligence, and Improving Software Quality","url":"https:\/\/www.nasa.gov\/centers-and-facilities\/nesc\/understanding-risk-artificial-intelligence-and-improving-software-quality\/","mainEntityOfPage":{"@type":"WebPage","@id":"https:\/\/www.nasa.gov\/centers-and-facilities\/nesc\/understanding-risk-artificial-intelligence-and-improving-software-quality\/"},"thumbnailUrl":"https:\/\/www.nasa.gov\/wp-content\/uploads\/2024\/03\/techup2023-pg50-51-art1.png?w=150&h=150&crop=1","image":{"@type":"ImageObject","url":"https:\/\/www.nasa.gov\/wp-content\/uploads\/2024\/03\/techup2023-pg50-51-art1.png"},"articleSection":"NASA Centers & Facilities","author":[{"@type":"Person","name":"Meagan Chappell"}],"creator":["Meagan Chappell"],"publisher":{"@type":"Organization","name":"NASA","logo":"https:\/\/www.nasa.gov\/wp-content\/themes\/nasa\/assets\/images\/nasa-logo.svg"},"keywords":["NASA Centers & Facilities","NASA Engineering and Safety Center"],"dateCreated":"2024-03-12T11:05:48Z","datePublished":"2024-03-12T11:05:48Z","dateModified":"2024-03-12T11:05:49Z"},"rendered":"<meta name=\"parsely-title\" content=\"Understanding Risk, Artificial Intelligence, and Improving Software Quality\" \/>\n<meta name=\"parsely-link\" content=\"https:\/\/www.nasa.gov\/centers-and-facilities\/nesc\/understanding-risk-artificial-intelligence-and-improving-software-quality\/\" \/>\n<meta name=\"parsely-type\" content=\"post\" \/>\n<meta name=\"parsely-image-url\" content=\"https:\/\/www.nasa.gov\/wp-content\/uploads\/2024\/03\/techup2023-pg50-51-art1.png?w=150&h=150&crop=1\" \/>\n<meta name=\"parsely-pub-date\" content=\"2024-03-12T11:05:48Z\" \/>\n<meta name=\"parsely-section\" content=\"NASA Centers & Facilities\" \/>\n<meta name=\"parsely-tags\" content=\"NASA Centers & Facilities,NASA Engineering and Safety Center\" \/>\n<meta name=\"parsely-author\" content=\"Meagan Chappell\" \/>","tracker_url":"https:\/\/cdn.parsely.com\/keys\/nasa.gov\/p.js"},"read_time":6,"time_ago":"3 months","featured_image":{"id":630520,"file":"https:\/\/www.nasa.gov\/wp-content\/uploads\/2024\/03\/techup2023-pg50-51-art1.png","title":"techup2023-pg50-51-art1","alt":"","caption":""},"_links":{"self":[{"href":"https:\/\/www.nasa.gov\/wp-json\/wp\/v2\/posts\/621169"}],"collection":[{"href":"https:\/\/www.nasa.gov\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.nasa.gov\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.nasa.gov\/wp-json\/wp\/v2\/users\/275"}],"replies":[{"embeddable":true,"href":"https:\/\/www.nasa.gov\/wp-json\/wp\/v2\/comments?post=621169"}],"version-history":[{"count":6,"href":"https:\/\/www.nasa.gov\/wp-json\/wp\/v2\/posts\/621169\/revisions"}],"predecessor-version":[{"id":653992,"href":"https:\/\/www.nasa.gov\/wp-json\/wp\/v2\/posts\/621169\/revisions\/653992"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.nasa.gov\/wp-json\/wp\/v2\/media\/630520"}],"wp:attachment":[{"href":"https:\/\/www.nasa.gov\/wp-json\/wp\/v2\/media?parent=621169"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.nasa.gov\/wp-json\/wp\/v2\/categories?post=621169"},{"taxonomy":"news-tags","embeddable":true,"href":"https:\/\/www.nasa.gov\/wp-json\/wp\/v2\/news-tags?post=621169"},{"taxonomy":"internal-terms","embeddable":true,"href":"https:\/\/www.nasa.gov\/wp-json\/wp\/v2\/internal-terms?post=621169"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.nasa.gov\/wp-json\/wp\/v2\/coauthors?post=621169"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}