webinar register page

Webinar banner
SERC TALKS: "Progress in Test and Evaluation of AI-enabled Systems in the DoD”
SERC TALKS: “Progress in Test and Evaluation of AI-enabled Systems in the DoD”

Speaker: Dr. Yevgeniya (Jane) Pinelis, Chief, Test and Evaluation of AI/ML, U.S. Department of Defense’s (DoD) Joint Artificial Intelligence Center (JAIC)

Abstract: Though the objectives of independent government test and evaluation (T&E) are similar between traditional and AI-enabled systems (AIES), the science, practice, skills, and infrastructure necessary to evaluate these data-dependent systems do require an update. Over the last two years, the DoD Joint AI Center (JAIC) has led the DoD test community in identifying and filling the gaps in T&E of AI. We have made great progress, in partnership with other DoD test stakeholders, academia, and industry. Together, we have put forward T&E frameworks, tools, and contracting approaches. This talk will discuss our existing challenges, current and aspirational solutions, and the way ahead for the DoD T&E of AIES.

This is the second Talk of the three-part series on "Test and Evaluation" to be moderated by: Dr. Laura Freeman, SERC Research Council member; Research Associate Professor, Statistics and Director, Intelligent Systems Lab, Hume Center, Virginia Tech.

Oct 29, 2021 01:00 PM in Eastern Time (US and Canada)

* Required information


Dr. Yevgeniya “Jane” Pinelis
Chief, Test, Evaluation, and Assessment @Department of Defense Joint Artificial Intelligence Center (JAIC)
Dr. Jane Pinelis is the Chief of the Test, Evaluation, and Assessment branch at the Department of Defense Joint Artificial Intelligence Center (JAIC). She leads a diverse team of testers and analysts in rigorous test and evaluation (T&E) for JAIC capabilities, as well as development of T&E-specific products and standards that will support testing of AI-enabled systems across the DoD. Prior to joining the JAIC, Dr. Pinelis served as the Director of Test and Evaluation for USDI’s Algorithmic Warfare Cross-Functional Team, better known as Project Maven. She directed the developmental testing for the AI models, including computer vision, machine translation, facial recognition and natural language processing. Her team developed metrics at various levels of testing for AI capabilities and provided leadership empirically-based recommendations for model fielding. Visit the event webpage for more information: https://sercuarc.org/event/serc-talks-2021-test-and-evaluation-2/