SERC TALKS: “Progress in Test and Evaluation of AI-enabled Systems in the DoD”
Speaker: Dr. Yevgeniya (Jane) Pinelis, Chief, Test and Evaluation of AI/ML, U.S. Department of Defense’s (DoD) Joint Artificial Intelligence Center (JAIC)
Abstract: Though the objectives of independent government test and evaluation (T&E) are similar between traditional and AI-enabled systems (AIES), the science, practice, skills, and infrastructure necessary to evaluate these data-dependent systems do require an update. Over the last two years, the DoD Joint AI Center (JAIC) has led the DoD test community in identifying and filling the gaps in T&E of AI. We have made great progress, in partnership with other DoD test stakeholders, academia, and industry. Together, we have put forward T&E frameworks, tools, and contracting approaches. This talk will discuss our existing challenges, current and aspirational solutions, and the way ahead for the DoD T&E of AIES.
This is the second Talk of the three-part series on "Test and Evaluation" to be moderated by: Dr. Laura Freeman, SERC Research Council member; Research Associate Professor, Statistics and Director, Intelligent Systems Lab, Hume Center, Virginia Tech.