Changes between Version 5 and Version 6 of Development/NightlyTests


Ignore:
Timestamp:
10/28/09 12:47:46 (8 years ago)
Author:
wehart
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • Development/NightlyTests

    v5 v6  
     1= Testing Philosophy = 
     2 
     3Our goal is to support a variety of different categories of software tests within Acro, including: 
     4 
     5 * Unit Tests - Tests that independently exercise C++ component interfaces 
     6 * Functionality Tests - Tests that validate the behavior of intra-package interfaces (these are notionally testing a higher-level concepts than are addressed by Unit Tests). 
     7 * Integration Tests - Tests that validate the behavior of inter-package interfaces 
     8 * Regression Tests - Tests that use simple 'diffs' of output (e.g. code that can be driven within shell scripts with config files). 
     9 * Performance Tests - Tests that evaluate runtime, cost and/or the number of iterations over a suite of test problems.  (Test comparisons are made with respect to a history of previous test results.) 
     10 * Benchmark Tests - Test that evaluate the absolute runtime, cost and/or number of iterations over a suite of test problems. (Test comparisons are made with respect to published results and/or third-party solvers.) 
     11 
     12The following table summarizes the types of tests that are supported within Acro, and the maturity of Acro's testing capabilities. 
     13 
    114== Build Tests == 
    215 * [http://software.sandia.gov/~sqe/testdata/acro/today/summary.html Build Test Report]