Commit Graph

204 Commits

Author SHA1 Message Date
Markus Kauppila
8b05e73c97 Little fix to help text in configure.ac 2011-08-06 21:48:37 +03:00
Markus Kauppila
249256f286 Trying to fix linux compatibility -> libSDLtest.* is now installed
to /usr/local/lib.
2011-08-06 21:32:59 +03:00
Markus Kauppila
fd2532dd93 Added Makefile.am's to hg. 2011-08-06 20:32:59 +03:00
Markus Kauppila
c881094c4a Fixed a bunch of compiler warnings. 2011-08-06 19:49:37 +03:00
Markus Kauppila
01d2623ed3 Fixed 'make distclean' 2011-08-06 19:17:05 +03:00
Markus Kauppila
2515783e58 Updated the boilerplate files such as INSTALL and README. 2011-08-06 18:55:33 +03:00
Markus Kauppila
9f3d7d915b Created data directory for test data.
Fixed platform test suite.
2011-08-06 18:29:14 +03:00
Markus Kauppila
4cac1cd629 Runner is automatically installed to . 2011-08-06 18:00:10 +03:00
Markus Kauppila
131443d044 Reorganizing the project. 2011-08-06 17:35:58 +03:00
Markus Kauppila
5778b9682b Added doxygen markup for the boundary value functions. 2011-08-04 21:09:17 +03:00
Markus Kauppila
5e3ab54d13 Cleaned the dummy suite a bit. 2011-08-04 20:54:27 +03:00
Markus Kauppila
74d2cb937a Added empty test suite for render tests. 2011-08-04 20:52:39 +03:00
Markus Kauppila
e947646f4e Added empty test suite for testing rwops. 2011-08-04 20:45:12 +03:00
Markus Kauppila
61dc8488b6 Added functions that generate random boundary values
for Uint16, Uint32 and Uint64 to the fuzzer.
2011-08-04 20:17:21 +03:00
Markus Kauppila
9c0da933bc Refining boundary value generator. 2011-08-03 20:43:32 +03:00
Markus Kauppila
fe5a22c87b Fixing execution key generation based on CR. 2011-08-02 12:46:40 +03:00
Markus Kauppila
81d704f311 Fixed ScanForTestSuites function based on CR. 2011-08-02 11:20:11 +03:00
Markus Kauppila
43946d2d3c Changed SetUpLogger based on CR. 2011-07-31 20:01:34 +03:00
Markus Kauppila
6271ef2a6b Fixed harness seed generation based on CR.
Fixed a bug from SetUpLogger() function.
2011-07-31 19:08:38 +03:00
Markus Kauppila
efd49aed8c Fixed type from usage info. 2011-07-29 19:52:16 +03:00
Markus Kauppila
7387bcbbd7 Fixed problem in ScanForTestSuites concerning hidden
files. Plus other little fixes.
2011-07-29 18:18:37 +03:00
Markus Kauppila
38b2cc186a Fixed potential memory leak from test case loading. 2011-07-29 16:22:03 +03:00
Markus Kauppila
99c9517327 Runner prints some info to user, including where
to find the generated test report.
2011-07-28 22:19:09 +03:00
Markus Kauppila
73fdc9b3a2 Fixed an issue with fuzzing seeds. 2011-07-28 22:11:30 +03:00
Markus Kauppila
b941bde492 Made run seed more file name friendly. 2011-07-28 21:35:47 +03:00
Markus Kauppila
820d737fd1 Logger logs to file on default.
Directory and file name can be changed by using options
--logdir and --logfile. Option --log-stdout forces harness
to log to stdout.
2011-07-28 18:32:27 +03:00
Markus Kauppila
fd7929d362 Added randomly generated harness seed. 2011-07-27 18:37:47 +03:00
Markus Kauppila
5f209dc9d5 Added simple logging levels to logging system.
Added new option: --verbose.
Fixed help for option --version.
2011-07-27 17:48:07 +03:00
Markus Kauppila
3f3320a7fb Changing the execution key generator.
Fixed --iterations option.
2011-07-25 20:32:31 +03:00
Markus Kauppila
7251d59000 Logger logs harness seed and test execution keys in hex representation. 2011-07-25 19:33:32 +03:00
Markus Kauppila
2e166cfb3c Refining the fuzzer. Adding new functions and fixing the old ones. 2011-07-25 18:51:57 +03:00
Markus Kauppila
0ac4925a83 Fixing the previous commit. 2011-07-24 18:58:36 +03:00
Markus Kauppila
a5ebb7f521 Adding elementary support for fuzzing.
New options: --seed [VALUE] --exec-key [EXEC-KEY] --iterations VALUE
2011-07-24 18:21:53 +03:00
Markus Kauppila
258f08af80 Merged two heads. 2011-07-21 14:22:17 +03:00
Markus Kauppila
2543e8b7e6 Added count of skipped tests to default xsl style. 2011-07-21 13:57:55 +03:00
Andreas Schiffler
b844233a79 Added test case for power management function; improved assertions in tests 2011-07-20 23:04:55 -07:00
Markus Kauppila
8b612370f7 Fixed linking issue concerning test suites.
Fixed linux build (it compiles and runs properly).
2011-07-20 23:37:58 +03:00
Markus Kauppila
6d8cf052b5 Fixing linking issues using shared object. 2011-07-20 19:57:42 +03:00
Markus Kauppila
46ab8884d2 Using SDL timer to kill hung tests. 2011-07-20 19:32:34 +03:00
Markus Kauppila
d7342505eb Refined test skipping. 2011-07-19 21:38:15 +03:00
Markus Kauppila
9932ea0a03 Testing out implementation for skipping unsupported test
automatically.
2011-07-18 22:26:26 +03:00
Markus Kauppila
7d9bdb201b Refined the string escaping algorithm. 2011-07-18 17:16:38 +03:00
Markus Kauppila
d758dadb41 Fixes to logging system. 2011-07-18 16:37:02 +03:00
Markus Kauppila
b5cc9e71e8 Added --timeout VALUE command option. 2011-07-18 16:16:41 +03:00
Markus Kauppila
6b1df38ab5 Refactored a bit. 2011-07-18 15:25:54 +03:00
Markus Kauppila
65b1827acc Harness warns about tests that request timeout when it's not
available.
2011-07-18 14:41:01 +03:00
Andreas Schiffler
f4722e408f Fixed SDL_SetError() by making NULL fmt a no-op, update test automation 2011-07-17 20:59:34 -07:00
Markus Kauppila
f7ec340c08 Merging two heads. 2011-07-17 19:19:35 +03:00
Markus Kauppila
f78b37d76c Fixed logging noise coming from unimplemented optional test
suite functions SetUp and TearDown.
2011-07-17 11:17:40 +03:00
Andreas Schiffler
d765305af1 Expanded and updated testplatform suite. 2011-07-16 20:12:25 -07:00
Markus Kauppila
9a4caf5f80 Fixed doxygen markup. 2011-07-14 21:04:31 +03:00
Markus Kauppila
61c4e3110e Added timeout for dummycase3 in libtestdummy. 2011-07-14 20:57:16 +03:00
Markus Kauppila
45d142967a Fixed incorrect assertions in surface test suite. 2011-07-14 20:43:32 +03:00
Markus Kauppila
495f7b476d Fixed AssertEquals. 2011-07-14 20:33:18 +03:00
Markus Kauppila
ba7e652c14 Harness kills hung tests (won't work with --in-proc option).
Added result description to test logs (tells why test failed,
such as exceeding its timeout).
2011-07-13 19:51:25 +03:00
Markus Kauppila
578690ca49 Plain logger logs the used command line options. 2011-07-12 23:53:57 +03:00
Markus Kauppila
a2cd498eef Breaking tests in surface to several smaller tests. 2011-07-12 16:47:50 +03:00
Markus Kauppila
fdd5716159 If any assert in SetUp function fails that test will be skipped. 2011-07-11 21:09:28 +03:00
Markus Kauppila
ce58837bbd Added SetUp/TearDown functions for test suites. 2011-07-11 17:55:35 +03:00
Markus Kauppila
bb09b8ebe8 Fixes based on CR. 2011-07-11 17:47:55 +03:00
Markus Kauppila
17a1b22cd4 Updated assert messages in surface test suite. 2011-07-10 18:48:31 +03:00
Markus Kauppila
e92d5a6712 Bunch of little fixes. 2011-07-10 18:42:52 +03:00
Markus Kauppila
1072d833cd Ported surface tests. 2011-07-09 17:55:35 +03:00
Markus Kauppila
084cc91e10 Ported common directory from automated. It contains common
helpers functions for some test suites.
2011-07-08 19:58:16 +03:00
Markus Kauppila
1de0e725ae Made the default XSL style less blocky. 2011-07-06 23:49:36 +03:00
Markus Kauppila
84896a8ed9 Fixed doxygen markup. 2011-07-06 17:05:07 +03:00
Markus Kauppila
a67ec6307f Fixed the interface between tests suites and logger.
Note: breaks the linux build.
2011-07-06 16:06:39 +03:00
Markus Kauppila
b4b444819d Added audio suite. 2011-07-05 22:11:12 +03:00
Markus Kauppila
4ff136f83e Added a skeleton stylesheet that can be used as a base for
developing a new stylesheet for XML test reports.
2011-07-05 21:27:35 +03:00
Markus Kauppila
52d2ac8f73 Made the output of plain logger more readable. 2011-07-05 21:15:34 +03:00
Markus Kauppila
c55dcdb34e Added command option --version 2011-07-04 20:46:06 +03:00
Markus Kauppila
935d50e942 Fixed './runner --xml --show-tests'. 2011-07-04 17:23:20 +03:00
Markus Kauppila
d1b18e21fe Help usage missed ] which added. 2011-07-03 20:22:30 +03:00
Markus Kauppila
fae7cc1e68 Fixed white space issue in XSL stylesheet. 2011-07-03 19:21:35 +03:00
Markus Kauppila
b7b0dc241f Changed the usage help. 2011-07-03 11:14:52 +03:00
Markus Kauppila
0cbfcc4081 Fixed XML logger. EscapeString didn't from strings properly. 2011-07-03 10:54:21 +03:00
Markus Kauppila
b3268149ff Cleaned up the build system. 'make clean' now deletes the installed
test suites (this should prevent old tests lingering around)
2011-07-01 22:15:23 +03:00
Markus Kauppila
1002730bb4 Fixed 'make install' errors by using a bash script. 2011-07-01 18:21:11 +03:00
Markus Kauppila
3d9b4247ae Fixed a bunch of Makefile.am files. 2011-07-01 17:11:20 +03:00
Markus Kauppila
cf6833c2d9 Fixed doxygen markup error. 2011-07-01 13:29:19 +03:00
Markus Kauppila
b6d3cc0464 Added better function for escaping strings. 2011-07-01 13:16:51 +03:00
Markus Kauppila
e886b2df50 Redefined the usage of --xsl command option. 2011-07-01 12:36:57 +03:00
Markus Kauppila
01d42cc048 Separated test suite name from its directory path. Fixes
usability issues concerning some command line options.
2011-07-01 11:12:35 +03:00
Markus Kauppila
9c090120d9 Removed directory from test suite names. 2011-06-30 18:11:48 +03:00
Markus Kauppila
12798fcd36 Added user-supplied XSL style sheets for XML-based test reports.
Added new command line option: --xsl.
2011-06-30 17:11:39 +03:00
Markus Kauppila
ee6776d5e5 Cleaned the XSL style a bit. 2011-06-30 16:08:37 +03:00
Markus Kauppila
8c669ce2b4 Refined the XSL style. 2011-06-29 22:23:06 +03:00
Markus Kauppila
bff35f5b46 Added some interactivity to XSLT stylesheet using javascript. 2011-06-29 20:34:59 +03:00
Markus Kauppila
2b5522d0d1 Fixed the calculation of total runtime for a suite. 2011-06-29 19:05:56 +03:00
Markus Kauppila
f5a3c50fea Added plain XLST file. 2011-06-29 17:40:32 +03:00
Markus Kauppila
cf467bdffa Fixed a few mistakes from XML logger. 2011-06-28 23:15:43 +03:00
Markus Kauppila
c4ca4288e4 Fixes based on CR. 2011-06-28 17:03:38 +03:00
Markus Kauppila
7ef7dc1c07 Added documentation. 2011-06-27 23:10:13 +03:00
Markus Kauppila
33540e51b1 Fixed test suite start time. 2011-06-27 22:39:38 +03:00
Markus Kauppila
6097dd444a Removed printf's from dummy test suite. 2011-06-27 22:16:32 +03:00
Markus Kauppila
48636ce522 Plain logger refined. 2011-06-27 22:14:48 +03:00
Markus Kauppila
3ac63a7264 Added time, date and total runtime information to the output by
logging system.
2011-06-27 21:41:34 +03:00
Markus Kauppila
38e9d81c9d Refining the output of XML logger. 2011-06-27 16:41:45 +03:00
Markus Kauppila
b0e36129e3 Added identation to the output of XML logger. 2011-06-27 11:53:14 +03:00
Markus Kauppila
ccbcb8034e Logging system added to harness. Logging system doesn't
yet utilize all the given parameters.
2011-06-26 23:04:37 +03:00