{"id":34106,"date":"2024-02-20T14:52:03","date_gmt":"2024-02-20T14:52:03","guid":{"rendered":"https:\/\/one.sightlinemg.com\/c4isrnet\/uncategorized\/2024\/02\/20\/scale-ai-to-evaluate-large-language-models-for-pentagon\/"},"modified":"2026-08-08T18:35:43","modified_gmt":"2026-08-08T18:35:43","slug":"scale-ai-to-evaluate-large-language-models-for-pentagon","status":"publish","type":"post","link":"https:\/\/one.sightlinemg.com\/c4isrnet\/artificial-intelligence\/2024\/02\/20\/scale-ai-to-evaluate-large-language-models-for-pentagon\/","title":{"rendered":"Scale AI to evaluate large language models for Pentagon"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\"><i>Editor\u2019s note: This article was updated Feb. 20, 2024, to more accurately reflect Scale AI\u2019s tasks.<\/i><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The U.S. Department of Defense selected Scale AI to help it test and evaluate generative artificial intelligence for military applications.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The California-based company announced the work with the <a href=\"https:\/\/www.c4isrnet.com\/battlefield-tech\/c2-comms\/2023\/05\/08\/pentagons-ai-office-rebooting-global-experiments-for-jadc2\/\" target=\"_blank\">Chief Digital and AI Office<\/a> on Feb. 20, the same day the CDAO was scheduled to kick off its conference in Washington, D.C., featuring discussions on the topic.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Generative AI is capable of generating text, images or other data outputs using algorithmic models in response to user prompts. Large language models are a type of generative AI that uses statistical relationships among text documents or other inputs, either by itself or through a supervised training process, to pump out essays, computer code, human-like conversation and more. Scale AI will produce benchmarks for such systems under the contract.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The Defense Department has expressed increasing interest in generative AI, but its uses remain debated. While a smart assistant or chatbot could efficiently find files, answer frequently asked questions or dig up contact information, such tools can also fuel disinformation campaigns, spoofing attempts and cyberattacks. The CDAO in August <a href=\"https:\/\/www.c4isrnet.com\/artificial-intelligence\/2023\/08\/10\/pentagon-establishes-task-force-lima-to-study-generative-ai-issues\/\" target=\"_blank\">launched Task Force Lima<\/a> to study and guide generative AI for national security purposes.<\/p>\n\n\n\t<aside class=\"smg-interstitial-link wp-block-smg-interstitial-link\">\n\t\t<a href=\"https:\/\/one.sightlinemg.com\/c4isrnet\/unmanned\/2024\/01\/29\/boeing-expands-drone-exams-to-lockheed-c-5-with-eye-on-broader-fleet\/\" class=\"smg-interstitial-link__inner\">\n\t\t\t\t\t\t\t<div class=\"smg-interstitial-link__media\">\n\t\t\t\t\t<img loading=\"lazy\" decoding=\"async\" width=\"300\" height=\"200\" src=\"https:\/\/one.sightlinemg.com\/wp-content\/uploads\/2026\/08\/Drone-Tail-Decals-Dover-AFB.jpg.jpg?w=300\" class=\"smg-interstitial-link__image wp-post-image\" alt=\"\" \/>\t\t\t\t<\/div>\n\t\t\t\t\t\t<div class=\"smg-interstitial-link__content\">\n\t\t\t\t<span class=\"smg-interstitial-link__kicker\">Related<\/span>\n\t\t\t\t<h3 class=\"smg-interstitial-link__title\">Boeing expands drone exams to Lockheed C-5 with eye on broader fleet<\/h3>\n\t\t\t\t\t\t\t\t\t<p class=\"smg-interstitial-link__excerpt\">&quot;You just can&#039;t do this stuff in a simulated environment,&quot; Boeing&#039;s Scott Belanger said of the Autonomous Aircraft Inspection initiative.<\/p>\n\t\t\t\t\t\t\t<\/div>\n\t\t<\/a>\n\t<\/aside>\n\t\n\n\n<p class=\"wp-block-paragraph\">\u201cTesting and evaluating generative AI will help the DOD understand the strengths and limitations of the technology, so it can be deployed responsibly,\u201d Alexandr Wang, the founder and chief executive of Scale, said in a statement. \u201cScale is honored to partner with the DOD on this framework.\u201d<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The Tuesday announcement did not include a dollar value for the work.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Wang in July told Congress outdated data-retention and -management policies were hamstringing the Defense Department. What is needed, he said at the time, is \u201cdoubling down on <a href=\"https:\/\/www.defensenews.com\/artificial-intelligence\/2023\/07\/18\/sluggish-procurement-stalling-pentagon-progress-on-ai-experts-say\/\" target=\"_blank\">some of these fast procurement methods<\/a> and ensuring that we continue to innovate.\u201d<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u201cAI systems are only as good as the data that they are trained on,\u201d he added.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Scale in 2022 won a nearly $250 million contract to provide federal agencies access to its technologies. The blanket purchasing agreement was issued by <a href=\"https:\/\/www.c4isrnet.com\/artificial-intelligence\/2022\/05\/26\/ai-less-about-killer-robots-more-about-pentagon-transformation-groen-says\/\" target=\"_blank\">the Joint AI Center<\/a>, which was subsumed by the CDAO.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Scale AI&#8217;s chief executive, Alexandr Wang, last year told Congress that \u201coutdated data-retention and -management policies\u201d were hamstringing the Pentagon.<\/p>\n","protected":false},"author":7,"featured_media":112795,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_yoast_wpseo_meta-robots-noindex":"","_yoast_wpseo_meta-robots-nofollow":"","_yoast_wpseo_canonical":"","_acf":"","_yoast_wpseo_primary_category":6,"_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","_smg_distribution_targets":{"10":{"categories":["industry","newsletters","daily-news-roundup","home","pentagon"],"primary_category":"industry"}}},"categories":[6,106,29,13,32],"tags":[],"coauthors":[3295],"class_list":["post-34106","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-artificial-intelligence","category-daily-brief","category-home","category-industry","category-newsletters"],"acf":{"subheadline":"","legacy_arc_id":"OX26PD6XIJACVBDQCE2LXNPOIM","arc_canonical_url":"\/artificial-intelligence\/2024\/02\/20\/scale-ai-to-evaluate-large-language-models-for-pentagon\/","remove_feature_photo":false,"is_sponsored":false,"subtype":"","redirect_url":"","disable_inline_ads":false,"native_logo_pretext":"Presented By:"},"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v26.0 (Yoast SEO v28.1) - https:\/\/yoast.com\/product\/yoast-seo-premium-wordpress\/ -->\n<title>Scale AI to evaluate large language models for Pentagon - C4ISRNet<\/title>\n<meta name=\"description\" content=\"Scale AI&#039;s chief executive, Alexandr Wang, last year told Congress that \u201coutdated data-retention and -management policies\u201d were hamstringing the Pentagon.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/one.sightlinemg.com\/c4isrnet\/artificial-intelligence\/2024\/02\/20\/scale-ai-to-evaluate-large-language-models-for-pentagon\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Scale AI to evaluate large language models for Pentagon\" \/>\n<meta property=\"og:description\" content=\"Scale AI&#039;s chief executive, Alexandr Wang, last year told Congress that \u201coutdated data-retention and -management policies\u201d were hamstringing the Pentagon.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/one.sightlinemg.com\/c4isrnet\/artificial-intelligence\/2024\/02\/20\/scale-ai-to-evaluate-large-language-models-for-pentagon\/\" \/>\n<meta property=\"og:site_name\" content=\"C4ISRNet\" \/>\n<meta property=\"article:published_time\" content=\"2024-02-20T14:52:03+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2026-08-08T18:35:43+00:00\" \/>\n<meta name=\"author\" content=\"Colin Demarest\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Colin Demarest\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\n\t    \"@context\": \"https:\\\/\\\/schema.org\",\n\t    \"@graph\": [\n\t        {\n\t            \"@type\": \"Article\",\n\t            \"@id\": \"https:\\\/\\\/one.sightlinemg.com\\\/c4isrnet\\\/artificial-intelligence\\\/2024\\\/02\\\/20\\\/scale-ai-to-evaluate-large-language-models-for-pentagon\\\/#article\",\n\t            \"isPartOf\": {\n\t                \"@id\": \"https:\\\/\\\/one.sightlinemg.com\\\/c4isrnet\\\/artificial-intelligence\\\/2024\\\/02\\\/20\\\/scale-ai-to-evaluate-large-language-models-for-pentagon\\\/\"\n\t            },\n\t            \"author\": {\n\t                \"name\": \"migration\",\n\t                \"@id\": \"https:\\\/\\\/one.sightlinemg.com\\\/c4isrnet\\\/#\\\/schema\\\/person\\\/cc76c831bb37a926738c8391fca7a3b1\"\n\t            },\n\t            \"headline\": \"Scale AI to evaluate large language models for Pentagon\",\n\t            \"datePublished\": \"2024-02-20T14:52:03+00:00\",\n\t            \"dateModified\": \"2026-08-08T18:35:43+00:00\",\n\t            \"mainEntityOfPage\": {\n\t                \"@id\": \"https:\\\/\\\/one.sightlinemg.com\\\/c4isrnet\\\/artificial-intelligence\\\/2024\\\/02\\\/20\\\/scale-ai-to-evaluate-large-language-models-for-pentagon\\\/\"\n\t            },\n\t            \"wordCount\": 361,\n\t            \"commentCount\": 0,\n\t            \"publisher\": {\n\t                \"@id\": \"https:\\\/\\\/one.sightlinemg.com\\\/c4isrnet\\\/#organization\"\n\t            },\n\t            \"image\": {\n\t                \"@id\": \"https:\\\/\\\/one.sightlinemg.com\\\/c4isrnet\\\/artificial-intelligence\\\/2024\\\/02\\\/20\\\/scale-ai-to-evaluate-large-language-models-for-pentagon\\\/#primaryimage\"\n\t            },\n\t            \"thumbnailUrl\": \"https:\\\/\\\/one.sightlinemg.com\\\/wp-content\\\/uploads\\\/2026\\\/08\\\/AP23199636992145.jpg.jpg\",\n\t            \"articleSection\": [\n\t                \"AI &amp; ML\",\n\t                \"Daily Brief\",\n\t                \"Home\",\n\t                \"Industry\",\n\t                \"Newsletters\"\n\t            ],\n\t            \"inLanguage\": \"en-US\",\n\t            \"potentialAction\": [\n\t                {\n\t                    \"@type\": \"CommentAction\",\n\t                    \"name\": \"Comment\",\n\t                    \"target\": [\n\t                        \"https:\\\/\\\/one.sightlinemg.com\\\/c4isrnet\\\/artificial-intelligence\\\/2024\\\/02\\\/20\\\/scale-ai-to-evaluate-large-language-models-for-pentagon\\\/#respond\"\n\t                    ]\n\t                }\n\t            ]\n\t        },\n\t        {\n\t            \"@type\": \"WebPage\",\n\t            \"@id\": \"https:\\\/\\\/one.sightlinemg.com\\\/c4isrnet\\\/artificial-intelligence\\\/2024\\\/02\\\/20\\\/scale-ai-to-evaluate-large-language-models-for-pentagon\\\/\",\n\t            \"url\": \"https:\\\/\\\/one.sightlinemg.com\\\/c4isrnet\\\/artificial-intelligence\\\/2024\\\/02\\\/20\\\/scale-ai-to-evaluate-large-language-models-for-pentagon\\\/\",\n\t            \"name\": \"Scale AI to evaluate large language models for Pentagon - C4ISRNet\",\n\t            \"isPartOf\": {\n\t                \"@id\": \"https:\\\/\\\/one.sightlinemg.com\\\/c4isrnet\\\/#website\"\n\t            },\n\t            \"primaryImageOfPage\": {\n\t                \"@id\": \"https:\\\/\\\/one.sightlinemg.com\\\/c4isrnet\\\/artificial-intelligence\\\/2024\\\/02\\\/20\\\/scale-ai-to-evaluate-large-language-models-for-pentagon\\\/#primaryimage\"\n\t            },\n\t            \"image\": {\n\t                \"@id\": \"https:\\\/\\\/one.sightlinemg.com\\\/c4isrnet\\\/artificial-intelligence\\\/2024\\\/02\\\/20\\\/scale-ai-to-evaluate-large-language-models-for-pentagon\\\/#primaryimage\"\n\t            },\n\t            \"thumbnailUrl\": \"https:\\\/\\\/one.sightlinemg.com\\\/wp-content\\\/uploads\\\/2026\\\/08\\\/AP23199636992145.jpg.jpg\",\n\t            \"datePublished\": \"2024-02-20T14:52:03+00:00\",\n\t            \"dateModified\": \"2026-08-08T18:35:43+00:00\",\n\t            \"description\": \"Scale AI's chief executive, Alexandr Wang, last year told Congress that \u201coutdated data-retention and -management policies\u201d were hamstringing the Pentagon.\",\n\t            \"breadcrumb\": {\n\t                \"@id\": \"https:\\\/\\\/one.sightlinemg.com\\\/c4isrnet\\\/artificial-intelligence\\\/2024\\\/02\\\/20\\\/scale-ai-to-evaluate-large-language-models-for-pentagon\\\/#breadcrumb\"\n\t            },\n\t            \"inLanguage\": \"en-US\",\n\t            \"potentialAction\": [\n\t                {\n\t                    \"@type\": \"ReadAction\",\n\t                    \"target\": [\n\t                        \"https:\\\/\\\/one.sightlinemg.com\\\/c4isrnet\\\/artificial-intelligence\\\/2024\\\/02\\\/20\\\/scale-ai-to-evaluate-large-language-models-for-pentagon\\\/\"\n\t                    ]\n\t                }\n\t            ]\n\t        },\n\t        {\n\t            \"@type\": \"ImageObject\",\n\t            \"inLanguage\": \"en-US\",\n\t            \"@id\": \"https:\\\/\\\/one.sightlinemg.com\\\/c4isrnet\\\/artificial-intelligence\\\/2024\\\/02\\\/20\\\/scale-ai-to-evaluate-large-language-models-for-pentagon\\\/#primaryimage\",\n\t            \"url\": \"https:\\\/\\\/one.sightlinemg.com\\\/wp-content\\\/uploads\\\/2026\\\/08\\\/AP23199636992145.jpg.jpg\",\n\t            \"contentUrl\": \"https:\\\/\\\/one.sightlinemg.com\\\/wp-content\\\/uploads\\\/2026\\\/08\\\/AP23199636992145.jpg.jpg\"\n\t        },\n\t        {\n\t            \"@type\": \"BreadcrumbList\",\n\t            \"@id\": \"https:\\\/\\\/one.sightlinemg.com\\\/c4isrnet\\\/artificial-intelligence\\\/2024\\\/02\\\/20\\\/scale-ai-to-evaluate-large-language-models-for-pentagon\\\/#breadcrumb\",\n\t            \"itemListElement\": [\n\t                {\n\t                    \"@type\": \"ListItem\",\n\t                    \"position\": 1,\n\t                    \"name\": \"Home\",\n\t                    \"item\": \"https:\\\/\\\/one.sightlinemg.com\\\/c4isrnet\\\/\",\n\t                    \"ad_zone\": \"home\"\n\t                },\n\t                {\n\t                    \"@type\": \"ListItem\",\n\t                    \"position\": 2,\n\t                    \"name\": \"AI &amp; ML\",\n\t                    \"item\": \"https:\\\/\\\/one.sightlinemg.com\\\/c4isrnet\\\/artificial-intelligence\\\/\",\n\t                    \"ad_zone\": \"artificial-intelligence\"\n\t                },\n\t                {\n\t                    \"@type\": \"ListItem\",\n\t                    \"position\": 3,\n\t                    \"name\": \"Scale AI to evaluate large language models for Pentagon\"\n\t                }\n\t            ]\n\t        },\n\t        {\n\t            \"@type\": \"WebSite\",\n\t            \"@id\": \"https:\\\/\\\/one.sightlinemg.com\\\/c4isrnet\\\/#website\",\n\t            \"url\": \"https:\\\/\\\/one.sightlinemg.com\\\/c4isrnet\\\/\",\n\t            \"name\": \"C4ISRNet\",\n\t            \"description\": \"Media for the Intelligence-Age Military | C4ISRNET\",\n\t            \"publisher\": {\n\t                \"@id\": \"https:\\\/\\\/one.sightlinemg.com\\\/c4isrnet\\\/#organization\"\n\t            },\n\t            \"potentialAction\": [\n\t                {\n\t                    \"@type\": \"SearchAction\",\n\t                    \"target\": {\n\t                        \"@type\": \"EntryPoint\",\n\t                        \"urlTemplate\": \"https:\\\/\\\/one.sightlinemg.com\\\/c4isrnet\\\/?s={search_term_string}\"\n\t                    },\n\t                    \"query-input\": {\n\t                        \"@type\": \"PropertyValueSpecification\",\n\t                        \"valueRequired\": true,\n\t                        \"valueName\": \"search_term_string\"\n\t                    }\n\t                }\n\t            ],\n\t            \"inLanguage\": \"en-US\"\n\t        },\n\t        {\n\t            \"@type\": \"Organization\",\n\t            \"@id\": \"https:\\\/\\\/one.sightlinemg.com\\\/c4isrnet\\\/#organization\",\n\t            \"name\": \"C4ISRNet\",\n\t            \"url\": \"https:\\\/\\\/one.sightlinemg.com\\\/c4isrnet\\\/\",\n\t            \"logo\": {\n\t                \"@type\": \"ImageObject\",\n\t                \"inLanguage\": \"en-US\",\n\t                \"@id\": \"https:\\\/\\\/one.sightlinemg.com\\\/c4isrnet\\\/#\\\/schema\\\/logo\\\/image\\\/\",\n\t                \"url\": \"https:\\\/\\\/one.sightlinemg.com\\\/wp-content\\\/uploads\\\/2026\\\/06\\\/c4isrnet-logo-white.png\",\n\t                \"contentUrl\": \"https:\\\/\\\/one.sightlinemg.com\\\/wp-content\\\/uploads\\\/2026\\\/06\\\/c4isrnet-logo-white.png\",\n\t                \"caption\": \"C4ISRNet\"\n\t            },\n\t            \"image\": {\n\t                \"@id\": \"https:\\\/\\\/one.sightlinemg.com\\\/c4isrnet\\\/#\\\/schema\\\/logo\\\/image\\\/\"\n\t            }\n\t        },\n\t        {\n\t            \"@type\": \"Person\",\n\t            \"@id\": \"https:\\\/\\\/one.sightlinemg.com\\\/c4isrnet\\\/#\\\/schema\\\/person\\\/cc76c831bb37a926738c8391fca7a3b1\",\n\t            \"name\": \"migration\",\n\t            \"image\": {\n\t                \"@type\": \"ImageObject\",\n\t                \"inLanguage\": \"en-US\",\n\t                \"@id\": \"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/9e8d47be443ce94ce7fc357677b5f9c70235bb1f59e7267a102a74af58c04f59?s=96&d=mm&r=gcf4cb6ee0ec29e49e7a963234e4340ec\",\n\t                \"url\": \"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/9e8d47be443ce94ce7fc357677b5f9c70235bb1f59e7267a102a74af58c04f59?s=96&d=mm&r=g\",\n\t                \"contentUrl\": \"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/9e8d47be443ce94ce7fc357677b5f9c70235bb1f59e7267a102a74af58c04f59?s=96&d=mm&r=g\",\n\t                \"caption\": \"migration\"\n\t            },\n\t            \"url\": \"https:\\\/\\\/one.sightlinemg.com\\\/c4isrnet\\\/author\\\/migration\\\/\"\n\t        }\n\t    ]\n\t}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Scale AI to evaluate large language models for Pentagon - C4ISRNet","description":"Scale AI's chief executive, Alexandr Wang, last year told Congress that \u201coutdated data-retention and -management policies\u201d were hamstringing the Pentagon.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/one.sightlinemg.com\/c4isrnet\/artificial-intelligence\/2024\/02\/20\/scale-ai-to-evaluate-large-language-models-for-pentagon\/","og_locale":"en_US","og_type":"article","og_title":"Scale AI to evaluate large language models for Pentagon","og_description":"Scale AI's chief executive, Alexandr Wang, last year told Congress that \u201coutdated data-retention and -management policies\u201d were hamstringing the Pentagon.","og_url":"https:\/\/one.sightlinemg.com\/c4isrnet\/artificial-intelligence\/2024\/02\/20\/scale-ai-to-evaluate-large-language-models-for-pentagon\/","og_site_name":"C4ISRNet","article_published_time":"2024-02-20T14:52:03+00:00","article_modified_time":"2026-08-08T18:35:43+00:00","author":"Colin Demarest","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Colin Demarest","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/one.sightlinemg.com\/c4isrnet\/artificial-intelligence\/2024\/02\/20\/scale-ai-to-evaluate-large-language-models-for-pentagon\/#article","isPartOf":{"@id":"https:\/\/one.sightlinemg.com\/c4isrnet\/artificial-intelligence\/2024\/02\/20\/scale-ai-to-evaluate-large-language-models-for-pentagon\/"},"author":{"name":"migration","@id":"https:\/\/one.sightlinemg.com\/c4isrnet\/#\/schema\/person\/cc76c831bb37a926738c8391fca7a3b1"},"headline":"Scale AI to evaluate large language models for Pentagon","datePublished":"2024-02-20T14:52:03+00:00","dateModified":"2026-08-08T18:35:43+00:00","mainEntityOfPage":{"@id":"https:\/\/one.sightlinemg.com\/c4isrnet\/artificial-intelligence\/2024\/02\/20\/scale-ai-to-evaluate-large-language-models-for-pentagon\/"},"wordCount":361,"commentCount":0,"publisher":{"@id":"https:\/\/one.sightlinemg.com\/c4isrnet\/#organization"},"image":{"@id":"https:\/\/one.sightlinemg.com\/c4isrnet\/artificial-intelligence\/2024\/02\/20\/scale-ai-to-evaluate-large-language-models-for-pentagon\/#primaryimage"},"thumbnailUrl":"https:\/\/one.sightlinemg.com\/wp-content\/uploads\/2026\/08\/AP23199636992145.jpg.jpg","articleSection":["AI &amp; ML","Daily Brief","Home","Industry","Newsletters"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/one.sightlinemg.com\/c4isrnet\/artificial-intelligence\/2024\/02\/20\/scale-ai-to-evaluate-large-language-models-for-pentagon\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/one.sightlinemg.com\/c4isrnet\/artificial-intelligence\/2024\/02\/20\/scale-ai-to-evaluate-large-language-models-for-pentagon\/","url":"https:\/\/one.sightlinemg.com\/c4isrnet\/artificial-intelligence\/2024\/02\/20\/scale-ai-to-evaluate-large-language-models-for-pentagon\/","name":"Scale AI to evaluate large language models for Pentagon - C4ISRNet","isPartOf":{"@id":"https:\/\/one.sightlinemg.com\/c4isrnet\/#website"},"primaryImageOfPage":{"@id":"https:\/\/one.sightlinemg.com\/c4isrnet\/artificial-intelligence\/2024\/02\/20\/scale-ai-to-evaluate-large-language-models-for-pentagon\/#primaryimage"},"image":{"@id":"https:\/\/one.sightlinemg.com\/c4isrnet\/artificial-intelligence\/2024\/02\/20\/scale-ai-to-evaluate-large-language-models-for-pentagon\/#primaryimage"},"thumbnailUrl":"https:\/\/one.sightlinemg.com\/wp-content\/uploads\/2026\/08\/AP23199636992145.jpg.jpg","datePublished":"2024-02-20T14:52:03+00:00","dateModified":"2026-08-08T18:35:43+00:00","description":"Scale AI's chief executive, Alexandr Wang, last year told Congress that \u201coutdated data-retention and -management policies\u201d were hamstringing the Pentagon.","breadcrumb":{"@id":"https:\/\/one.sightlinemg.com\/c4isrnet\/artificial-intelligence\/2024\/02\/20\/scale-ai-to-evaluate-large-language-models-for-pentagon\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/one.sightlinemg.com\/c4isrnet\/artificial-intelligence\/2024\/02\/20\/scale-ai-to-evaluate-large-language-models-for-pentagon\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/one.sightlinemg.com\/c4isrnet\/artificial-intelligence\/2024\/02\/20\/scale-ai-to-evaluate-large-language-models-for-pentagon\/#primaryimage","url":"https:\/\/one.sightlinemg.com\/wp-content\/uploads\/2026\/08\/AP23199636992145.jpg.jpg","contentUrl":"https:\/\/one.sightlinemg.com\/wp-content\/uploads\/2026\/08\/AP23199636992145.jpg.jpg"},{"@type":"BreadcrumbList","@id":"https:\/\/one.sightlinemg.com\/c4isrnet\/artificial-intelligence\/2024\/02\/20\/scale-ai-to-evaluate-large-language-models-for-pentagon\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/one.sightlinemg.com\/c4isrnet\/","ad_zone":"home"},{"@type":"ListItem","position":2,"name":"AI &amp; ML","item":"https:\/\/one.sightlinemg.com\/c4isrnet\/artificial-intelligence\/","ad_zone":"artificial-intelligence"},{"@type":"ListItem","position":3,"name":"Scale AI to evaluate large language models for Pentagon"}]},{"@type":"WebSite","@id":"https:\/\/one.sightlinemg.com\/c4isrnet\/#website","url":"https:\/\/one.sightlinemg.com\/c4isrnet\/","name":"C4ISRNet","description":"Media for the Intelligence-Age Military | C4ISRNET","publisher":{"@id":"https:\/\/one.sightlinemg.com\/c4isrnet\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/one.sightlinemg.com\/c4isrnet\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/one.sightlinemg.com\/c4isrnet\/#organization","name":"C4ISRNet","url":"https:\/\/one.sightlinemg.com\/c4isrnet\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/one.sightlinemg.com\/c4isrnet\/#\/schema\/logo\/image\/","url":"https:\/\/one.sightlinemg.com\/wp-content\/uploads\/2026\/06\/c4isrnet-logo-white.png","contentUrl":"https:\/\/one.sightlinemg.com\/wp-content\/uploads\/2026\/06\/c4isrnet-logo-white.png","caption":"C4ISRNet"},"image":{"@id":"https:\/\/one.sightlinemg.com\/c4isrnet\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/one.sightlinemg.com\/c4isrnet\/#\/schema\/person\/cc76c831bb37a926738c8391fca7a3b1","name":"migration","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/9e8d47be443ce94ce7fc357677b5f9c70235bb1f59e7267a102a74af58c04f59?s=96&d=mm&r=gcf4cb6ee0ec29e49e7a963234e4340ec","url":"https:\/\/secure.gravatar.com\/avatar\/9e8d47be443ce94ce7fc357677b5f9c70235bb1f59e7267a102a74af58c04f59?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/9e8d47be443ce94ce7fc357677b5f9c70235bb1f59e7267a102a74af58c04f59?s=96&d=mm&r=g","caption":"migration"},"url":"https:\/\/one.sightlinemg.com\/c4isrnet\/author\/migration\/"}]}},"jetpack_featured_media_url":"https:\/\/one.sightlinemg.com\/wp-content\/uploads\/2026\/08\/AP23199636992145.jpg.jpg","jetpack_sharing_enabled":true,"distributor_meta":false,"distributor_terms":false,"distributor_media":false,"distributor_original_site_name":"C4ISRNet","distributor_original_site_url":"https:\/\/one.sightlinemg.com\/c4isrnet","push-errors":false,"_links":{"self":[{"href":"https:\/\/one.sightlinemg.com\/c4isrnet\/wp-json\/wp\/v2\/posts\/34106","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/one.sightlinemg.com\/c4isrnet\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/one.sightlinemg.com\/c4isrnet\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/one.sightlinemg.com\/c4isrnet\/wp-json\/wp\/v2\/users\/7"}],"replies":[{"embeddable":true,"href":"https:\/\/one.sightlinemg.com\/c4isrnet\/wp-json\/wp\/v2\/comments?post=34106"}],"version-history":[{"count":2,"href":"https:\/\/one.sightlinemg.com\/c4isrnet\/wp-json\/wp\/v2\/posts\/34106\/revisions"}],"predecessor-version":[{"id":44196,"href":"https:\/\/one.sightlinemg.com\/c4isrnet\/wp-json\/wp\/v2\/posts\/34106\/revisions\/44196"}],"wp:attachment":[{"href":"https:\/\/one.sightlinemg.com\/c4isrnet\/wp-json\/wp\/v2\/media?parent=34106"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/one.sightlinemg.com\/c4isrnet\/wp-json\/wp\/v2\/categories?post=34106"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/one.sightlinemg.com\/c4isrnet\/wp-json\/wp\/v2\/tags?post=34106"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/one.sightlinemg.com\/c4isrnet\/wp-json\/wp\/v2\/coauthors?post=34106"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}