After a while the buzzwords start to ring hollow. What\u2019s \u201cartificial intelligence,\u201d in practical terms? An Orwellian nightmare that will control our every battlefield maneuver? Or a helpful tool to aid the war fighter?<\/p>\n\n\n\n
Let\u2019s bring it down to Earth, make it tangible. AI can, for instance, scan a live video feed faster and more accurately than any human and then warn commanders of imminent danger.<\/p>\n\n\n\n
At least that\u2019s the premise behind an ongoing project at the Air Force Research Laboratory at Wright-Patterson Air Force Base. \u201cVideo is captured with such velocity and volume [that] no individual or team of individuals can hope to analyze that data in a meaningful way,\u201d said Scott Clouse, senior research engineer at the Decision Science Branch.<\/p>\n\n\n\n
AI offers a faster, smarter alternative.<\/p>\n\n\n\n
While video intelligence can be an invaluable resource, it\u2019s also a massive manpower suck. \u201cIn some instances, we are up to teams of 30 people looking at one video feed, just to make sure we don\u2019t miss anything,\u201d Clouse said.<\/p>\n\n\n\n
\u201cThere is an immediate need to cut down the number of people on a single feed, maybe even to the point where we could have a single person looking at multiple feeds. It could dramatically reduce the workload on the force.\u201d<\/p>\n\n\n\n
In late 2017 the AFRL research team hit a milestone in its work, winning the Large-Scale Movie Description Challenge at the 2017 International Conference on Computer Vision in Venice, Italy. In that competition, AI-driven systems were tasked with creating simple written descriptions of short clips taken from commercial film footage.<\/p>\n\n\n\n
The techniques used here could in principal serve as the basis for an AI-driven situational awareness tool. While the team kept its movie captions deliberately terse \u2014 \u201cSomeone looks up, someone reads a letter\u201d \u2014 video interpretation on the battlefield could perhaps offer an even deeper dive into video intelligence.<\/p>\n\n\n\n
\u201cOn the battlefield you are not competing with the other audio, you are not competing with music in the background. You could deliver a more lengthy verbal description,\u201d said Vincent Velten, AFRL\u2019s Multi-Domain Sensing Autonomy Division Decision Science Branch technical advisor.<\/p>\n\n\n\n
The time factor<\/b><\/p>\n\n\n\n
For AI to interpret video data, the system must be told what to look for. Right now, programmers can set a simple system to identify specific shapes or colors or types of activity. Moving forward, they want the AI-driven system to cull more detailed information. In technical terms, the mechanism that enables this is called a recurrent neural net, or RNN.<\/p>\n\n\n\n
The RNN adds the memory component to the process. \u201cThis is what gives you time, and time is what gives you context,\u201d Clouse said.<\/p>\n\n\n\n
\u201cYou see a person standing next to the truck and then you see a person sitting in the truck. You can intuit that person got into the truck. You start to see relationships in the sequences.\u201d<\/p>\n\n\n\n
There\u2019s some urgency to this work, as the military comes to rely ever more heavily on video capture as a situational awareness tool. Velten pointed especially to the Air Force\u2019s use of video feeds from remotely piloted aircraft.<\/p>\n\n\n\n
\u201cThe Air Force makes a lot of use of this stuff, and then there are also the small UAVs that are becoming more and more interesting. That is right now the principle motivation,\u201d he said.<\/p>\n\n\n\n
The AFRL team needs about five more years to produce a battlefield-worthy version of its video scanning AI tool. To get to the finish line, researchers need to spend more time looking at actual intel and tackling specific military objectives.<\/p>\n\n\n\n
Just as last year\u2019s movie competition had a specific tactical goal \u2014 caption five seconds of a movie \u2014 the researchers need to build their tools around specific ISR objectives. The AI is only as good at what you tell it to do, and they\u2019re still refining the process of writing those instructions for the machines to follow.<\/p>\n\n\n\n
\u201cWe have a lot of data right now. What we need are concrete objectives to train the system,\u201d Clouse said.<\/p>\n\n\n\n
\u201cWe need an operational setting where we have some data that is labeled or captioned appropriately that we can feed into the training mechanism, in order to train the systems on what to look for.\u201d<\/p>\n\n\n\n
If it works, an AI-driven system could make it easier to pull the most important information from a video feed.<\/p>\n\n\n\n
Watching video takes time, far more time than it would take to read a simple sentence or two the sums up the relevant action. \u201cWe want to efficiently translate all this video information into a semantic form that is efficient for people to use,\u201d Clouse said.<\/p>\n\n\n\n
\u201cFundamentally it means that you know what is going on and you know what has changed, without having to stare at every frame as it goes by.\u201d<\/p>\n","protected":false},"excerpt":{"rendered":"
The Air Force Research Laboratory at Wright-Patterson Air Force Base is exploring how artificial intelligence can drive video interpretation and situational awareness.<\/p>\n","protected":false},"author":7,"featured_media":80843,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_yoast_wpseo_meta-robots-noindex":"","_yoast_wpseo_meta-robots-nofollow":"","_yoast_wpseo_canonical":"","_acf":"","_yoast_wpseo_primary_category":41,"_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","_smg_distribution_targets":[]},"categories":[106,29,15,41,32],"tags":[],"coauthors":[2063],"class_list":["post-28543","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-daily-brief","category-home","category-intel-geoint","category-isr","category-newsletters"],"acf":{"subheadline":"","legacy_arc_id":"PFXSBVGCIRHG7OLCDGHGCGUCOE","arc_canonical_url":"\/intel-geoint\/isr\/2018\/05\/31\/will-ai-help-save-lives-on-the-battlefield\/","remove_feature_photo":false,"is_sponsored":false,"subtype":"","redirect_url":"","disable_inline_ads":false,"native_logo_pretext":"Presented By:"},"yoast_head":"\n