Commit Graph

4491 Commits

Author SHA1 Message Date
Markus Kauppila
820d737fd1 Logger logs to file on default.
Directory and file name can be changed by using options
--logdir and --logfile. Option --log-stdout forces harness
to log to stdout.
2011-07-28 18:32:27 +03:00
Markus Kauppila
fd7929d362 Added randomly generated harness seed. 2011-07-27 18:37:47 +03:00
Markus Kauppila
5f209dc9d5 Added simple logging levels to logging system.
Added new option: --verbose.
Fixed help for option --version.
2011-07-27 17:48:07 +03:00
Markus Kauppila
3f3320a7fb Changing the execution key generator.
Fixed --iterations option.
2011-07-25 20:32:31 +03:00
Markus Kauppila
7251d59000 Logger logs harness seed and test execution keys in hex representation. 2011-07-25 19:33:32 +03:00
Markus Kauppila
2e166cfb3c Refining the fuzzer. Adding new functions and fixing the old ones. 2011-07-25 18:51:57 +03:00
Markus Kauppila
0ac4925a83 Fixing the previous commit. 2011-07-24 18:58:36 +03:00
Markus Kauppila
a5ebb7f521 Adding elementary support for fuzzing.
New options: --seed [VALUE] --exec-key [EXEC-KEY] --iterations VALUE
2011-07-24 18:21:53 +03:00
Markus Kauppila
258f08af80 Merged two heads. 2011-07-21 14:22:17 +03:00
Markus Kauppila
2543e8b7e6 Added count of skipped tests to default xsl style. 2011-07-21 13:57:55 +03:00
Andreas Schiffler
b844233a79 Added test case for power management function; improved assertions in tests 2011-07-20 23:04:55 -07:00
Markus Kauppila
8b612370f7 Fixed linking issue concerning test suites.
Fixed linux build (it compiles and runs properly).
2011-07-20 23:37:58 +03:00
Markus Kauppila
6d8cf052b5 Fixing linking issues using shared object. 2011-07-20 19:57:42 +03:00
Markus Kauppila
46ab8884d2 Using SDL timer to kill hung tests. 2011-07-20 19:32:34 +03:00
Markus Kauppila
d7342505eb Refined test skipping. 2011-07-19 21:38:15 +03:00
Markus Kauppila
9932ea0a03 Testing out implementation for skipping unsupported test
automatically.
2011-07-18 22:26:26 +03:00
Markus Kauppila
7d9bdb201b Refined the string escaping algorithm. 2011-07-18 17:16:38 +03:00
Markus Kauppila
d758dadb41 Fixes to logging system. 2011-07-18 16:37:02 +03:00
Markus Kauppila
b5cc9e71e8 Added --timeout VALUE command option. 2011-07-18 16:16:41 +03:00
Markus Kauppila
6b1df38ab5 Refactored a bit. 2011-07-18 15:25:54 +03:00
Markus Kauppila
65b1827acc Harness warns about tests that request timeout when it's not
available.
2011-07-18 14:41:01 +03:00
Andreas Schiffler
f4722e408f Fixed SDL_SetError() by making NULL fmt a no-op, update test automation 2011-07-17 20:59:34 -07:00
Markus Kauppila
f7ec340c08 Merging two heads. 2011-07-17 19:19:35 +03:00
Markus Kauppila
f78b37d76c Fixed logging noise coming from unimplemented optional test
suite functions SetUp and TearDown.
2011-07-17 11:17:40 +03:00
Andreas Schiffler
d765305af1 Expanded and updated testplatform suite. 2011-07-16 20:12:25 -07:00
Markus Kauppila
9a4caf5f80 Fixed doxygen markup. 2011-07-14 21:04:31 +03:00
Markus Kauppila
61c4e3110e Added timeout for dummycase3 in libtestdummy. 2011-07-14 20:57:16 +03:00
Markus Kauppila
45d142967a Fixed incorrect assertions in surface test suite. 2011-07-14 20:43:32 +03:00
Markus Kauppila
495f7b476d Fixed AssertEquals. 2011-07-14 20:33:18 +03:00
Markus Kauppila
ba7e652c14 Harness kills hung tests (won't work with --in-proc option).
Added result description to test logs (tells why test failed,
such as exceeding its timeout).
2011-07-13 19:51:25 +03:00
Markus Kauppila
578690ca49 Plain logger logs the used command line options. 2011-07-12 23:53:57 +03:00
Markus Kauppila
a2cd498eef Breaking tests in surface to several smaller tests. 2011-07-12 16:47:50 +03:00
Markus Kauppila
fdd5716159 If any assert in SetUp function fails that test will be skipped. 2011-07-11 21:09:28 +03:00
Markus Kauppila
ce58837bbd Added SetUp/TearDown functions for test suites. 2011-07-11 17:55:35 +03:00
Markus Kauppila
bb09b8ebe8 Fixes based on CR. 2011-07-11 17:47:55 +03:00
Markus Kauppila
17a1b22cd4 Updated assert messages in surface test suite. 2011-07-10 18:48:31 +03:00
Markus Kauppila
e92d5a6712 Bunch of little fixes. 2011-07-10 18:42:52 +03:00
Markus Kauppila
1072d833cd Ported surface tests. 2011-07-09 17:55:35 +03:00
Markus Kauppila
084cc91e10 Ported common directory from automated. It contains common
helpers functions for some test suites.
2011-07-08 19:58:16 +03:00
Markus Kauppila
1de0e725ae Made the default XSL style less blocky. 2011-07-06 23:49:36 +03:00
Markus Kauppila
84896a8ed9 Fixed doxygen markup. 2011-07-06 17:05:07 +03:00
Markus Kauppila
a67ec6307f Fixed the interface between tests suites and logger.
Note: breaks the linux build.
2011-07-06 16:06:39 +03:00
Markus Kauppila
b4b444819d Added audio suite. 2011-07-05 22:11:12 +03:00
Markus Kauppila
4ff136f83e Added a skeleton stylesheet that can be used as a base for
developing a new stylesheet for XML test reports.
2011-07-05 21:27:35 +03:00
Markus Kauppila
52d2ac8f73 Made the output of plain logger more readable. 2011-07-05 21:15:34 +03:00
Markus Kauppila
c55dcdb34e Added command option --version 2011-07-04 20:46:06 +03:00
Markus Kauppila
935d50e942 Fixed './runner --xml --show-tests'. 2011-07-04 17:23:20 +03:00
Markus Kauppila
d1b18e21fe Help usage missed ] which added. 2011-07-03 20:22:30 +03:00
Markus Kauppila
fae7cc1e68 Fixed white space issue in XSL stylesheet. 2011-07-03 19:21:35 +03:00
Markus Kauppila
b7b0dc241f Changed the usage help. 2011-07-03 11:14:52 +03:00