Room 3 

11:40 - 12:40 


Talk (60 min)

Auto-testing for situational awareness

Why do you do automatic end-to-end testing? For keeping out regressions? For selecting and promoting release candidates? While we do those things at Neat, our ultimate aim for autotesting is creating situational awareness. Testing for situational awareness means moving beyond the spatial dimension, that of just tracking where in the system functional requirements fail. It introduces time, tracking when issues pop up in or depart from different code branches or release channels. It also involves moving beyond red and green, following the variations in other significant metrics over time, like test run durations and the numbers of actually executed tests. This talk will cover the gory details of CI yaml, dashboards and the practical strategies we use to see as much of the situation as possible, including how it evolves over time.


James Westfall

James has been working for over 20 years in software and hardware development. He has worked with test automation since 2008 and has gradually switched from a successful developer and architect role over to an experienced test automation specialist role. James focuses on how automatic End-to-End testing can bring together all the participants in an agile team and deliver value early in the requirements gathering and active development stages, long before the software is close to being finished. When not giving Neat’s video-conference solutions strange dreams, James enjoys the Norwegian outdoors, especially when skiing and flyfishing.