User Tools

Site Tools


test_suite

This is an old revision of the document!


Quick overview

We run all our tests on two machines, one 32-bit (Andrew's computer) and one 64-bit (navy.eecg.utoronto.ca), both running Linux. We test using the dejagnu framework, and testing code can be found in dejagnu and examples/lib. We visualize and automate these tests using buildbot at: http://www.legup.org:9100/waterfall.

Sept 17, 2010

Basic test: Run all dummy tests for correctness. Run all benchmarks at full optimization and inlining on ModelSim and Quartus to get performance results.

Current status: Passing.

Full test: Run all tests on tiger with varying levels of optimization. Run all Verilog simulations at lower optimization levels. Run all hybrid tests with ModelSim.

Current status: Failing. motion without inlining fails on tiger (and would on gxemul). May be related to loopbug error, which is an error with the LLVM Mips back-end on calling conventions.

Hybrid: Run SW/HW hybrid with the most compute-intensive function accelerated into hardware. Run with Quartus to get performance results.

Current status: Passing.

Hybrid2: Run SW/HW hybrid with the two most compute-intensive functions accelerated into hardware. Run with Quartus to get performance results.

Current status: Failing. blowfish2 is incorrect because of I/O pins.

Oct 6, 2010

Basic test: Passing

Full test: Passing

Hybrid: Failing. Slight error on parsing results of Tiger after running Quartus (Timing Analyzer).

Hybrid2: Passing

Oct 9, 2010

Basic test: Failing. The new jpeg has an error.

Full test: Failing. The new jpeg has an error.

Hybrid: Failing. Slight error on parsing results of Tiger after running Quartus (Timing Analyzer).

Hybrid2: Passing

Dec 10, 2010

Basic test: Passing.

Full test: Failing. Binding error.

Hybrid: Passing.

Hybrid2: Passing

Mar 15, 2011

Just in time for the Release:

Basic test: Passing.

Full test: Passing.

test_suite.1300232862.txt.gz · Last modified: 2011/03/15 19:47 by zhangvi1