National Ignition Facility TestController for automated and manual testing

The Controls and Information Systems (CIS) organization for the National Ignition Facility (NIF) has developed controls, configuration and analysis software applications that combine for several million lines of code. The team delivers updates throughout the year, from major releases containing hundreds of changes to patch releases containing a small number of focused updates. To ensure the quality of each delivery, manual and automated tests are performed using the NIF TestController test infrastructure. The TestController system provides test inventory management, test planning, automated and manual test execution, release testing summaries and results search, all through a web browser interface. As part of the three-stage software testing strategy, the NIF TestController system helps plan, evaluate and track the readiness of each release to the NIF production environment. After several years of use in testing NIF software applications, the TestController's manual testing features have been leveraged for verifying the installation and operation of NIF Target Diagnostic hardware. The TestController recorded its first test results in 2004. Today, the system has recorded the execution of more than 160,000 tests and continues to play a central role in ensuring that NIF hardware and software meet the requirements of a high reliability facility. This paper describes the TestController system and discusses its use in assuring the quality of software delivered to the NIF.