Specification-based Testing using Goals, Plans, and Scenarios

Specification-based Testing using Goals, Plans, and Scenarios (Poster, Demo)
Students: Kristina Winbladh, UCI/ISR
Advisor: Debra J. Richardson, UCI/ISR, Thomas Alspaugh, UCI/ISR
Abstract: This poster presents a specification-based testing approach and implementation architecture that addresses several known challenges including false positives and domain knowledge errors. The approach begins with a system goal graph and functional goal plans. Source code is annotated with goals from plans the program is attempting to achieve; code is then precompiled to emit annotations at run time. Plans are automatically translated into a rule-based recognizer. An oracle is produced from the pre- and post-conditions associated with the plan's goals. When the program is executed, goals and events are emitted and automatically tested against plans and expected results. This allows more efficient testing, including better recognition of false positives - correct results not matching plans - and domain knowledge errors - incorrect results from following intended plans. The concept is demonstrated with samples from a Tic-Tac-Toe example and an ATM case study.

Bio: Kristina Winbladh is a first year Ph.D. student at UCI. Her focus area is Software Engineering, and more particularly Requirements Engineering and Testing. She is fortunate to work with a group of Professors in both areas works with Professors Thomas Alspaugh and Debra J. Richardson. One of her long term goals is to incorporate software requirements into each development step and close the loop by verifying that the software meets its requirements through specification-based testing.