Commit Graph

739 Commits

Author SHA1 Message Date
Ryan C. Gordon
e308b7f557 testmultiaudio.c needs to #include <stdio.h>. 2011-08-03 03:12:07 -04:00
Markus Kauppila
fe5a22c87b Fixing execution key generation based on CR. 2011-08-02 12:46:40 +03:00
Markus Kauppila
81d704f311 Fixed ScanForTestSuites function based on CR. 2011-08-02 11:20:11 +03:00
Markus Kauppila
43946d2d3c Changed SetUpLogger based on CR. 2011-07-31 20:01:34 +03:00
Markus Kauppila
6271ef2a6b Fixed harness seed generation based on CR.
Fixed a bug from SetUpLogger() function.
2011-07-31 19:08:38 +03:00
Markus Kauppila
efd49aed8c Fixed type from usage info. 2011-07-29 19:52:16 +03:00
Markus Kauppila
7387bcbbd7 Fixed problem in ScanForTestSuites concerning hidden
files. Plus other little fixes.
2011-07-29 18:18:37 +03:00
Markus Kauppila
38b2cc186a Fixed potential memory leak from test case loading. 2011-07-29 16:22:03 +03:00
Markus Kauppila
99c9517327 Runner prints some info to user, including where
to find the generated test report.
2011-07-28 22:19:09 +03:00
Markus Kauppila
73fdc9b3a2 Fixed an issue with fuzzing seeds. 2011-07-28 22:11:30 +03:00
Markus Kauppila
b941bde492 Made run seed more file name friendly. 2011-07-28 21:35:47 +03:00
Markus Kauppila
820d737fd1 Logger logs to file on default.
Directory and file name can be changed by using options
--logdir and --logfile. Option --log-stdout forces harness
to log to stdout.
2011-07-28 18:32:27 +03:00
Markus Kauppila
fd7929d362 Added randomly generated harness seed. 2011-07-27 18:37:47 +03:00
Markus Kauppila
5f209dc9d5 Added simple logging levels to logging system.
Added new option: --verbose.
Fixed help for option --version.
2011-07-27 17:48:07 +03:00
Markus Kauppila
3f3320a7fb Changing the execution key generator.
Fixed --iterations option.
2011-07-25 20:32:31 +03:00
Markus Kauppila
7251d59000 Logger logs harness seed and test execution keys in hex representation. 2011-07-25 19:33:32 +03:00
Markus Kauppila
2e166cfb3c Refining the fuzzer. Adding new functions and fixing the old ones. 2011-07-25 18:51:57 +03:00
Markus Kauppila
0ac4925a83 Fixing the previous commit. 2011-07-24 18:58:36 +03:00
Markus Kauppila
a5ebb7f521 Adding elementary support for fuzzing.
New options: --seed [VALUE] --exec-key [EXEC-KEY] --iterations VALUE
2011-07-24 18:21:53 +03:00
Markus Kauppila
258f08af80 Merged two heads. 2011-07-21 14:22:17 +03:00
Markus Kauppila
2543e8b7e6 Added count of skipped tests to default xsl style. 2011-07-21 13:57:55 +03:00
Andreas Schiffler
b844233a79 Added test case for power management function; improved assertions in tests 2011-07-20 23:04:55 -07:00
Markus Kauppila
8b612370f7 Fixed linking issue concerning test suites.
Fixed linux build (it compiles and runs properly).
2011-07-20 23:37:58 +03:00
Markus Kauppila
6d8cf052b5 Fixing linking issues using shared object. 2011-07-20 19:57:42 +03:00
Markus Kauppila
46ab8884d2 Using SDL timer to kill hung tests. 2011-07-20 19:32:34 +03:00
Markus Kauppila
d7342505eb Refined test skipping. 2011-07-19 21:38:15 +03:00
Markus Kauppila
9932ea0a03 Testing out implementation for skipping unsupported test
automatically.
2011-07-18 22:26:26 +03:00
Markus Kauppila
7d9bdb201b Refined the string escaping algorithm. 2011-07-18 17:16:38 +03:00
Markus Kauppila
d758dadb41 Fixes to logging system. 2011-07-18 16:37:02 +03:00
Markus Kauppila
b5cc9e71e8 Added --timeout VALUE command option. 2011-07-18 16:16:41 +03:00
Markus Kauppila
6b1df38ab5 Refactored a bit. 2011-07-18 15:25:54 +03:00
Markus Kauppila
65b1827acc Harness warns about tests that request timeout when it's not
available.
2011-07-18 14:41:01 +03:00
Andreas Schiffler
f4722e408f Fixed SDL_SetError() by making NULL fmt a no-op, update test automation 2011-07-17 20:59:34 -07:00
Markus Kauppila
f7ec340c08 Merging two heads. 2011-07-17 19:19:35 +03:00
Markus Kauppila
f78b37d76c Fixed logging noise coming from unimplemented optional test
suite functions SetUp and TearDown.
2011-07-17 11:17:40 +03:00
Andreas Schiffler
d765305af1 Expanded and updated testplatform suite. 2011-07-16 20:12:25 -07:00
Markus Kauppila
9a4caf5f80 Fixed doxygen markup. 2011-07-14 21:04:31 +03:00
Markus Kauppila
61c4e3110e Added timeout for dummycase3 in libtestdummy. 2011-07-14 20:57:16 +03:00
Markus Kauppila
45d142967a Fixed incorrect assertions in surface test suite. 2011-07-14 20:43:32 +03:00
Markus Kauppila
495f7b476d Fixed AssertEquals. 2011-07-14 20:33:18 +03:00
Markus Kauppila
ba7e652c14 Harness kills hung tests (won't work with --in-proc option).
Added result description to test logs (tells why test failed,
such as exceeding its timeout).
2011-07-13 19:51:25 +03:00
Markus Kauppila
578690ca49 Plain logger logs the used command line options. 2011-07-12 23:53:57 +03:00
Markus Kauppila
a2cd498eef Breaking tests in surface to several smaller tests. 2011-07-12 16:47:50 +03:00
Markus Kauppila
fdd5716159 If any assert in SetUp function fails that test will be skipped. 2011-07-11 21:09:28 +03:00
Markus Kauppila
ce58837bbd Added SetUp/TearDown functions for test suites. 2011-07-11 17:55:35 +03:00
Markus Kauppila
bb09b8ebe8 Fixes based on CR. 2011-07-11 17:47:55 +03:00
Markus Kauppila
17a1b22cd4 Updated assert messages in surface test suite. 2011-07-10 18:48:31 +03:00
Markus Kauppila
e92d5a6712 Bunch of little fixes. 2011-07-10 18:42:52 +03:00
Markus Kauppila
1072d833cd Ported surface tests. 2011-07-09 17:55:35 +03:00
Markus Kauppila
084cc91e10 Ported common directory from automated. It contains common
helpers functions for some test suites.
2011-07-08 19:58:16 +03:00
Markus Kauppila
1de0e725ae Made the default XSL style less blocky. 2011-07-06 23:49:36 +03:00
Markus Kauppila
84896a8ed9 Fixed doxygen markup. 2011-07-06 17:05:07 +03:00
Markus Kauppila
a67ec6307f Fixed the interface between tests suites and logger.
Note: breaks the linux build.
2011-07-06 16:06:39 +03:00
Markus Kauppila
b4b444819d Added audio suite. 2011-07-05 22:11:12 +03:00
Markus Kauppila
4ff136f83e Added a skeleton stylesheet that can be used as a base for
developing a new stylesheet for XML test reports.
2011-07-05 21:27:35 +03:00
Markus Kauppila
52d2ac8f73 Made the output of plain logger more readable. 2011-07-05 21:15:34 +03:00
Markus Kauppila
c55dcdb34e Added command option --version 2011-07-04 20:46:06 +03:00
Markus Kauppila
935d50e942 Fixed './runner --xml --show-tests'. 2011-07-04 17:23:20 +03:00
Markus Kauppila
d1b18e21fe Help usage missed ] which added. 2011-07-03 20:22:30 +03:00
Markus Kauppila
fae7cc1e68 Fixed white space issue in XSL stylesheet. 2011-07-03 19:21:35 +03:00
Markus Kauppila
b7b0dc241f Changed the usage help. 2011-07-03 11:14:52 +03:00
Markus Kauppila
0cbfcc4081 Fixed XML logger. EscapeString didn't from strings properly. 2011-07-03 10:54:21 +03:00
Markus Kauppila
b3268149ff Cleaned up the build system. 'make clean' now deletes the installed
test suites (this should prevent old tests lingering around)
2011-07-01 22:15:23 +03:00
Markus Kauppila
1002730bb4 Fixed 'make install' errors by using a bash script. 2011-07-01 18:21:11 +03:00
Markus Kauppila
3d9b4247ae Fixed a bunch of Makefile.am files. 2011-07-01 17:11:20 +03:00
Markus Kauppila
cf6833c2d9 Fixed doxygen markup error. 2011-07-01 13:29:19 +03:00
Markus Kauppila
b6d3cc0464 Added better function for escaping strings. 2011-07-01 13:16:51 +03:00
Markus Kauppila
e886b2df50 Redefined the usage of --xsl command option. 2011-07-01 12:36:57 +03:00
Markus Kauppila
01d42cc048 Separated test suite name from its directory path. Fixes
usability issues concerning some command line options.
2011-07-01 11:12:35 +03:00
Markus Kauppila
9c090120d9 Removed directory from test suite names. 2011-06-30 18:11:48 +03:00
Markus Kauppila
12798fcd36 Added user-supplied XSL style sheets for XML-based test reports.
Added new command line option: --xsl.
2011-06-30 17:11:39 +03:00
Markus Kauppila
ee6776d5e5 Cleaned the XSL style a bit. 2011-06-30 16:08:37 +03:00
Markus Kauppila
8c669ce2b4 Refined the XSL style. 2011-06-29 22:23:06 +03:00
Markus Kauppila
bff35f5b46 Added some interactivity to XSLT stylesheet using javascript. 2011-06-29 20:34:59 +03:00
Markus Kauppila
2b5522d0d1 Fixed the calculation of total runtime for a suite. 2011-06-29 19:05:56 +03:00
Markus Kauppila
f5a3c50fea Added plain XLST file. 2011-06-29 17:40:32 +03:00
Markus Kauppila
cf467bdffa Fixed a few mistakes from XML logger. 2011-06-28 23:15:43 +03:00
Markus Kauppila
c4ca4288e4 Fixes based on CR. 2011-06-28 17:03:38 +03:00
Markus Kauppila
7ef7dc1c07 Added documentation. 2011-06-27 23:10:13 +03:00
Markus Kauppila
33540e51b1 Fixed test suite start time. 2011-06-27 22:39:38 +03:00
Markus Kauppila
6097dd444a Removed printf's from dummy test suite. 2011-06-27 22:16:32 +03:00
Markus Kauppila
48636ce522 Plain logger refined. 2011-06-27 22:14:48 +03:00
Markus Kauppila
3ac63a7264 Added time, date and total runtime information to the output by
logging system.
2011-06-27 21:41:34 +03:00
Markus Kauppila
38e9d81c9d Refining the output of XML logger. 2011-06-27 16:41:45 +03:00
Markus Kauppila
b0e36129e3 Added identation to the output of XML logger. 2011-06-27 11:53:14 +03:00
Markus Kauppila
ccbcb8034e Logging system added to harness. Logging system doesn't
yet utilize all the given parameters.
2011-06-26 23:04:37 +03:00
Markus Kauppila
66a5bc6a81 Added case insensitivity to XML elements. 2011-06-24 14:35:14 +03:00
Markus Kauppila
3605a116df XML component no longer outputs the generated XML.
Fixed a bunch of compiler warnings.
2011-06-23 22:00:03 +03:00
Markus Kauppila
b4411f83b1 Fixed XML elements. Element's end tag is now properly formed. 2011-06-23 21:11:48 +03:00
Markus Kauppila
a0937cabe5 Added escaping special characters to their corresponding
entities in XML output.
2011-06-22 21:56:23 +03:00
Markus Kauppila
8a21c1e5ae Changed XML-generator to use static buffer instead of dynamically
allocated memory.
2011-06-22 18:13:06 +03:00
Markus Kauppila
95d54f4c4a XML elements now support single attribute. Fixes here and there. 2011-06-22 17:41:37 +03:00
Markus Kauppila
70261760dc Various fixes and additions to logger system. 2011-06-21 22:04:44 +03:00
Markus Kauppila
fab5f54fd3 Creating flexible logging system which supports XML and plain
text. Work under progress.
2011-06-21 19:31:46 +03:00
Markus Kauppila
d361b710ff Refining XML-output module 2011-06-19 19:52:35 +03:00
Markus Kauppila
37785a86c2 Very early version of module that creates XML-based test reports. 2011-06-19 18:07:37 +03:00
Markus Kauppila
306370a258 Ported platform tests, added AssertPass and AssertFail 2011-06-18 10:36:27 -07:00
Markus Kauppila
1059c5101f Changed the title for README 2011-06-19 13:43:03 +03:00
Markus Kauppila
f4a3a831a4 Added new command line option: --show-tests 2011-06-13 15:38:40 +03:00
Markus Kauppila
54610f623f Stub for generating doxygen main page from README. 2011-06-11 21:52:31 +03:00
Markus Kauppila
a41dd0ab5c Added timeout to TestCaseReference. 2011-06-11 21:37:28 +03:00
Markus Kauppila
913c312c8e Compatibility fix. Apparently all system don't have d_namlen member
in their DIR struct.
2011-06-11 08:11:03 -07:00
Markus Kauppila
9eb8995a5d Fixed doxygen comments and usage help. 2011-06-09 18:30:06 +03:00
Markus Kauppila
43397ce08d Updated test case filter. 2011-06-09 18:13:46 +03:00
Markus Kauppila
9bf36c262a Added comments and did some cleaning. 2011-06-09 18:07:50 +03:00
Markus Kauppila
a4812a8bf2 Added test and suite names to the output. 2011-06-09 17:13:33 +03:00
Markus Kauppila
9a6ef3175b Creating pipeline for test case selection. Work in progress. 2011-06-09 16:37:51 +03:00
Markus Kauppila
3aedb87c6b Removed unnecessary function. 2011-06-08 19:41:12 +03:00
Markus Kauppila
99a5717c93 Fix: memory allocated for test suite references is freed 2011-06-08 18:38:38 +03:00
Markus Kauppila
3681c6e522 Initial version of "scan tests/ for test suites" functionality. 2011-06-07 21:11:11 +03:00
Markus Kauppila
813dff463b Add a comment. 2011-06-06 21:16:18 +03:00
Markus Kauppila
0aa772bb98 Minor refactorings. 2011-06-06 18:37:53 +03:00
Markus Kauppila
2ed100a0cc Converted libtest to a more proper dummy test suite (libtestdummy). 2011-06-06 18:15:19 +03:00
Markus Kauppila
37e7051d12 Fix: Use DEFINE instead of plain number. 2011-06-05 18:44:58 +03:00
Markus Kauppila
c761e7bd79 Refactored a bit. Extracted the code which checks for
test suite selection to a function.
2011-06-05 18:38:06 +03:00
Markus Kauppila
f313322848 Small fixes to previous commit. 2011-06-05 17:34:04 +03:00
Markus Kauppila
b0a57ac402 Possible to execute only selected tests or suites. 2011-06-05 16:10:10 +03:00
Markus Kauppila
b6d5aa6142 Runner can execute multiple test suites consecutively. 2011-06-04 18:50:41 +03:00
Markus Kauppila
31ed925ea9 Fixed old comments and added new ones. 2011-06-04 18:08:54 +03:00
Markus Kauppila
1c52082e17 Test case fails if it doesn't contain any asserts. 2011-06-04 17:58:46 +03:00
Markus Kauppila
6e6d706e75 Refactoring the TestCaseInit and TestCaseQuit functions
to be caller from the Runner.
2011-06-04 17:50:23 +03:00
Markus Kauppila
991519d59d Ported testrect from original automation code, updated AssertEquals, added AssertTrue 2011-06-01 18:03:09 -07:00
Markus Kauppila
0a18a5b73a Refactoring runner.c. Added --help/-h command line option. 2011-06-01 12:29:19 +03:00
Markus Kauppila
50805a6b0a Fixes to doxygen comments.
Changed some printf() to fprints(stderr).
2011-05-31 14:40:28 +03:00
Markus Kauppila
b96acda96a Moved tests/SDL_test.{c,h} 2011-05-30 21:57:04 +03:00
Markus Kauppila
ced3b56198 Fixed doxygen warnings 2011-05-30 18:58:20 +03:00
Markus Kauppila
9ef336918a Refactoring the code (runner.c).
Adding support for executing tests in-proc.
2011-05-30 12:55:40 +03:00
Markus Kauppila
79359313d4 Added doxygen-compatible comments 2011-05-30 11:53:59 +03:00
Andreas Schiffler
40bfbbdbf9 Fixed global suite declaration segfault via external linkage declaration 2011-05-26 20:13:49 -07:00
Markus Kauppila
e022f90b60 Little fixes here and there. 2011-05-26 19:57:03 +03:00
Markus Kauppila
7a278b2f78 Added TestCaseReference structure. 2011-05-26 19:19:46 +03:00
Markus Kauppila
94e6e4cea9 Refactoring the massive main() to smaller functions. 2011-05-26 18:38:56 +03:00
Markus Kauppila
f3bee868b4 Some fixes for Linux compatibility. 2011-05-25 09:45:03 -07:00
Markus Kauppila
53b99958d9 Fixed an error from make target: install 2011-05-25 19:02:43 +03:00
Markus Kauppila
09e6c52b0e New automake-based build process. 2011-05-25 18:53:48 +03:00
Markus Kauppila
f218d77732 Simplifying 2011-05-24 10:25:25 +03:00
Markus Kauppila
553838dce5 Tiny changes to runner 2011-05-23 17:49:06 +03:00
Markus Kauppila
5af8eaab18 Added assertEquals(Uint32, Uint32) function 2011-05-23 13:14:09 +03:00
Markus Kauppila
f052579c0b Tiny Makefile.in fixes 2011-05-23 10:43:49 +03:00
Markus Kauppila
f9c339ef02 Bootstrapping build process using proof-of-concept test runner. 2011-05-20 13:50:52 +03:00
Sam Lantinga
cca381f73f Added test of the assertion reporting system 2011-04-19 11:41:45 -07:00
Sam Lantinga
6196aa221e SDL 1.3 is now under the zlib license. 2011-04-08 13:03:26 -07:00
Sam Lantinga
93d1e1f0bf Backed out changeset ef550bdb8c1b 2011-03-28 20:33:41 -07:00
Ryan C. Gordon
af4cde4abc If a test program window resizes, resize its viewport, too. 2011-03-28 23:20:54 -04:00
Ryan C. Gordon
fe1c0bd3ae Added orientation rotation for iOS. 2011-03-28 23:21:22 -04:00
Sam Lantinga
ae58a49f62 NDS update
Frank Zago to SDL

There's also a patch to adapt one test for the nds, and that adds several
makefiles to compile these tests. Whenever you apply it, could you completely
remove the test/nds-test-progs/sprite and test/nds-test-progs/sprite2
directories ?
2011-03-26 21:28:17 -07:00
Sam Lantinga
065886413a Temporarily removing sprite and sprite2 at Frank's request 2011-03-26 21:27:23 -07:00
Sam Lantinga
56c4464487 Added high resolution timing API: SDL_GetPerformanceCounter(), SDL_GetPerformanceFrequency() 2011-03-25 14:45:04 -07:00
Sam Lantinga
f0c424685b SDL 1.3 requires a 64-bit type for the platform. 2011-03-25 13:47:49 -07:00
Sam Lantinga
b12e397498 Don't be clever, just call it testthread 2011-03-25 11:09:57 -07:00