WASHINGTON – New software developed by BAE Systems could help the Department of Defense build confidence in decisions and intelligence produced by machine learning algorithms, the company claims.<\/p>\n\n\n\n
BAE Systems said it recently delivered its new MindfuL software program to the Defense Advanced Research Projects Agency in a July 14 announcement. Developed in collaboration with the Massachusetts Institute of Technology\u2019s Computer Science and Artificial Intelligence Laboratory, the software is designed to increase transparency in machine learning systems\u2014artificial intelligence algorithms that learn and change over time as they are fed ever more data\u2014by auditing them to provide insights about how it reached its decisions.<\/p>\n\n\n\n
\u201cThe technology that underpins machine learning and artificial intelligence applications is rapidly advancing, and now it\u2019s time to ensure these systems can be integrated, utilized, and ultimately trusted in the field,\u201d said Chris Eisenbies, product line director of the cmpany\u2019s Autonomy, Control, and Estimation group. \u201cThe MindfuL system stores relevant data in order to compare the current environment to past experiences and deliver findings that are easy to understand.\u201d<\/p>\n\n\n\n
While machine learning algorithms show promise for DoD systems, determining how much users can trust their output remains a challenge. Intelligence officials have repeatedly noted that analysts cannot rely on black box artificial intelligence systems that simply produce a decision or piece of intelligence\u2014they need to understand how the system came to that decision and what unseen biases (in the training data or otherwise) might be influencing that decision.<\/p>\n\n\n\n
MindfuL is designed to help address that gap by providing more context around those outputs. For instance, the company says its program will issue statements such as\u201d \u201cThe machine learning system has navigated obstacles in sunny, dry environments 1,000 times and completed the task with greater than 99 percent accuracy under similar conditions;\u201d or \u201cThe machine learning system has only navigated obstacles in rain 100 times with 80 percent accuracy in similar conditions; manual override recommended.\u201d Those types of statements can help users evaluate how much confidence they should place in any individual decision produced by the system.<\/p>\n\n\n\n
This is the first release of the MindfuL software as part of a $5 million, three-year contract under DARPA\u2019s Competency-Aware Machine Learning (CAML) program. BAE Systems plans to demonstrate their software in both simulation and in prototype hardware later this year.<\/p>\n","protected":false},"excerpt":{"rendered":"
BAE Systems says their new MindfuL software will essentially audit machine learning systems, providing human users with more context about the systems’ output.<\/p>\n","protected":false},"author":7,"featured_media":26561,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_yoast_wpseo_meta-robots-noindex":"","_yoast_wpseo_meta-robots-nofollow":"","_yoast_wpseo_canonical":"","_acf":"","_yoast_wpseo_primary_category":12,"_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","_smg_distribution_targets":[]},"categories":[160,12,36],"tags":[],"coauthors":[3385],"class_list":["post-37604","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-daily-news-roundup","category-industry","category-newsletters"],"acf":{"subheadline":"","legacy_arc_id":"JC4ZCGL2KVAQVABQDZ35NOTF6Y","arc_canonical_url":"\/artificial-intelligence\/2020\/07\/20\/could-this-software-help-users-trust-machine-learning-decisions\/","remove_feature_photo":false,"is_sponsored":false,"subtype":"","redirect_url":"","disable_inline_ads":false,"native_logo_pretext":"Presented By:"},"yoast_head":"\n