Latest news with #ICEAA
Associated Press
23-06-2025
- Business
- Associated Press
The Training Data Project Wins Prestigious ICEAA 2025 Best Paper Award for Work on AI Data Labeling and Risk Reduction
06/23/2025, Washington, D.C // PRODIGY: Feature Story // David Cook, Co-Founder of The Training Data Project (Source: The Training Data Project) The Training Data Project, a company focused on quantifying AI value and pioneering data labeling standards, has been awarded the 2025 Best Paper honor by the International Cost Estimating and Analysis Association (ICEAA) in the Management, EVM, Software & Agile category. The winning paper, 'Enabling Measurable Success in DoD AI Programs from Acquisition to Operations,' highlights the central role that training data and data labeling play in AI performance, accountability, and long-term program value. The paper, co-authored by The Training Data Project co-founder David Cook, was selected from a competitive field of government and industry contributors. It outlines a practical methodology for quantifying the value and risk associated with AI systems in Department of Defense programs, beginning not at deployment, but at the foundation: the training data pipeline. 'It's an incredible honor to be recognized by the ICEAA, especially at a conference of cost estimators, a community I've never formally belonged to,' said Cook. 'But that's also the point. As AI continues to expand, its financial and operational value depends on something often overlooked: the integrity of the data we feed into it.' At the core of The Training Data Project's mission is the belief that nothing moves in AI without quality data. Data labeling, the process of annotating and identifying data points to 'teach' AI models what to pay attention to, is the bridge between raw inputs and intelligent outcomes. When done incorrectly, the results can be not just ineffective, but dangerous. 'Bad training data is worse than no training data,' Cook added. 'Mistakes made early in the labeling process don't just vanish. They cascade. They replicate through the system like compound interest, and by the time you spot the failure, the only option might be to start over.' To train an AI to recognize a stop sign, for example, it's not enough to feed it thousands of perfectly clear images. The model must also be exposed to a wide range of real-world variations including poor lighting, partial obstructions, weather damage, unusual angles, and visual interference. The more representative and well-labeled the training data, the better the AI can generalize and respond accurately in unpredictable, real-life conditions. 'Training data is not optional, it is foundational,' said Cook. 'Its importance spans all forms of AI. For Large Language Models, which depend on scale, diversity, and structure to function, it is absolutely crucial. Without standards and measurable quality in training data, organizations invite unquantifiable risk across the entire AI pipeline. Value in AI begins with value in the data.' Founded in 2023 by Cook and CEO Noami DeVore, The Training Data Project helps government and enterprise organizations navigate the complex intersection of data labeling, AI governance, and risk reduction. The company's mission is structured around a framework it calls TRUST: Transparent, Reachable, Unbiased, Standards-based, and Traceable data practices. Its work spans three primary pillars: defining quality and standards for training data, sharing best practices for cost-effective curation, and developing open source tools that support responsible AI deployment. From military applications to commercial AI systems, The Training Data Project offers a clear warning and a hopeful path forward. If organizations commit to data quality at the outset, they can unlock both innovation and measurable value while avoiding costly downstream failures. Media Contact: Name - Noami DeVore Email - [email protected]
Yahoo
16-05-2025
- Business
- Yahoo
Figure Eight Federal wins award at ICEAA 2025
Figure Eight Federal Wins Award for Innovative Framework to Assess Risk and Deliver Value in Federal AI Investments WASHINGTON, May 16, 2025--(BUSINESS WIRE)--Figure Eight Federal (F8F), in partnership with the Training Data Project and Technomics, received the Best Paper award for the Management, Earned Value Management (EVM), Software, and Agile track at the 2025 International Cost Estimating and Analysis Association (ICEAA) Conference. Titled "Enabling Measurable Success in DoD AI Programs from Acquisition to Operations," the paper introduces a novel methodology for aligning acquisition strategy, risk, AI training data, and program oversight with mission outcomes. The research proposes integrating qualitative and quantitative risk scoring into AI program oversight, enabling real-time course correction, transparent accountability, and data-driven decision-making across acquisition lifecycles. Despite its central role, AI training data is too often approached as an artistic guesswork rather than a measurable, scientific discipline. Without a structured method for estimating how many labels are needed, or which labels are most valuable, agencies are left navigating complexity without a compass—contributing to wasted resources, brittle models, and stalled progress. "Without quantifiable quality in your AI training data, you introduce unquantifiable risk to your downstream models and program outcomes. The ability to optimize costs and deliver innovation for AI models requires an understanding of how each label will contribute to driving mission readiness," said Tim Klawa, Head of Product at Figure Eight Federal. The paper highlights the critical role of AI training data in the success or failure of AI programs. With a well-designed training data strategy that incorporates actionable metrics, organizations can identify performance issues early, make informed decisions about resource allocation, and save both time and cost. "We believe that responsible AI is AI that creates measurable value," said Dave Cook, CEO of The Training Data project. "By combining the unique knowledge and experience of our team, we've created a new way for organizations to measure and manage AI, quantify risk and value, and adopt AI in a mission-aligned and cost-effective way." The ICEAA award recognizes F8F's and its partners' contribution to advancing practical, evidence-based frameworks for managing AI investments. For media inquiries, access to the paper, or to schedule interviews, contact: info@ About Figure Eight Federal Figure Eight Federal (F8F), is a leading provider of data labeling technology dedicated to eliminating the ambiguity and uncertainty that often hinder traditional AI initiatives. By bringing precision and accountability to labeling campaigns, F8F focuses on accelerating AI innovation in the Federal sector. Backed by over 25 years of industry experience, F8F's data labeling technology has supported some of the most advanced AI models, where understanding the cost and value of each label has been critical to achieving mission success. Unlock the potential of defense and intelligence data at View source version on Contacts Media Contact:Brittany Bowen, BPR InternationalBrittanySabra@ 614.226.9542 Error in retrieving data Sign in to access your portfolio Error in retrieving data Error in retrieving data Error in retrieving data Error in retrieving data
