Verification of Autonomous Systems Working Group Meeting at NIST, November 13-14, 2018

Meeting Goals

Our goals were to begin to assemble the various tools available into a coherent process for the verification of autonomous systems - to see what's missing and what's effectively done, and at what stages of the design and development process the different tools should be applied.

Agenda

November 13, 2018

Time Activity
0830-0900 Registration & Check-In
0900-0930 Introduction, Goals, Agenda
0930-0950 Task Ontology Overview (Craig Schlenoff)
0950-1010 Capability Analysis (Signe Redfield)
1010-1030 Break
1030-1050 Verifiable Autonomous Systems Architectures (Michael Fisher)
1050-1110 Frameworks (Richard Tatum)
1110-1130 Training Data Assessment (Matthew Hill)
1130-1150 RAPT (Galen Mullins)
1150-1300 Lunch
1300-1320 Developing Critical Systems: Process, Methods and Tools (Constance Heitmeyer)
1320-1340 Proposed Verification Process (Signe Redfield & David Tate)
1340-1500 Discussion
1500-1520 Break
1520-1700 Discussion
1520-1700 Discussion
1800-2000 No-host Dinner

November 14, 2018

Time Activity
0830-0900 Registration & Check-In
0900-0920 Recap of yesterday's discussion
0920-0930 IEEE Guidelines presentation and discussion (Craig Schlenoff)
0930-0950 Autonomy Verification (John Sustersic)
0950-1030 Process Discussion
1030-1200 Tour of NIST Robotics Labs
1200-1300 Lunch
1300-1330 Landscape of Challenges and Approaches (Matthew Hill)
1330-1400 Challenges and Gaps Discussion
1400-1500 Process Discussion, Continued
1500-1520 Break
1520-1650 Process Discussion
1650-1700 Closing Remarks

Results

The outcome of this meeting was (1) the development of this site including the Terminology wiki and the Challenges & Tools wiki and (2) the development of a conceptual model for verification processes.