piwik framework test suite port

Created by: Lester Caine, Last modification: 23 Feb 2012 (09:03 GMT)

Current state of play with test suite from piwik development branch on Firebird port

The majority of remaining errors are to be expected with the current state of the port to Firebird. A few things have been bypassed to allow progress, and now we need to sort out how to restore them in a manor that will also allow cross database working later. A few changes have simply replaced MySQL specific code with the Firebird equivalent, and now we need to identify a method that allows both to co-exist

DocumentationGenerator.test.php

Exception: Test_Piwik_API_DocumentationGenerator -> test_callableApiMethods_doNotFail -> Unexpected PHP error [ibase_fetch_row(): Dynamic SQL Error SQL error code = -303 conversion error from string "http://forum.piwik.org/" ] severity [E_WARNING] in [/srv/website/piwik/libs/Zend/Db/Statement/Firebird.php line 304]

IP.test.php

Currently bypassing N2P and need to tidy IP6 handling
1/1 test cases complete: 378 passes, 102 fails and 10 exceptions.

Option.test.php

Fail: Test_Piwik_Option -> test_deleteLike -> at [/srv/website/piwik/tests/core/Option.test.php line 136]
Fail: Test_Piwik_Option -> test_deleteLike -> at [/srv/website/piwik/tests/core/Option.test.php line 146]
Fail: Test_Piwik_Option -> test_deleteLike -> at [/srv/website/piwik/tests/core/Option.test.php line 147]
Firebird does not have a 'false' data type
1/1 test cases complete: 42 passes, 3 fails and 0 exceptions.

Piwik/jsProxy.test.php

Fail: Test_Piwik_jsProxy -> test_piwik_php -> Ok response at [/srv/website/piwik/tests/core/Piwik/jsProxy.test.php line 35]
Fail: Test_Piwik_jsProxy -> test_piwik_php -> image content at [/srv/website/piwik/tests/core/Piwik/jsProxy.test.php line 37]
string(0) ""
1/1 test cases complete: 2 passes, 2 fails and 0 exceptions.

Piwik/serveStaticFile.test.php

Security issues
[chmod(): Operation not permitted] severity [E_WARNING]
[touch(): Utime failed: Permission denied]
Failues
Fail: Test_Piwik_serveStaticFile -> test_nonReadableFile -> Equal expectation fails because [Integer: 200] differs from [Integer: 505] by 305 at [/srv/website/piwik/tests/core/Piwik/serveStaticFile.test.php line 175]
Fail: Test_Piwik_serveStaticFile -> test_compressionCacheInvalidation -> Not equal expectation fails [Integer: 1329983939] matches at [/srv/website/piwik/tests/core/Piwik/serveStaticFile.test.php line 431]
1/1 test cases complete: 20 passes, 2 fails and 15 exceptions.

ReleaseCheckList.test.php

manifest needs updating although there will be problems with svnKeywords checks if repo is switched to DVCS which does not tag files normally (pet hate with hg setup - need to work out how to add these to production releses)
1/1 test cases complete: 1519 passes, 363 fails and 0 exceptions.

Segment.test.php

Exception: Test_Piwik_Segment -> test_getSelectQuery_joinVisitOnConversion -> Unexpected exception of type [Exception] with message [Table ' HOUR FROM log_visit' can't be used for segmentation] in [/srv/website/piwik/core/Segment.php line 272]
Except 'HOUR FROM' has been replaced by 'EXTRACT (HOURS' so don't know
Also need to ad check to see if customeVariables is loaded as these give errors when switched off
1/1 test cases complete: 17 passes, 0 fails and 8 exceptions.

TablePartitioning.test.php

creating a name longer than 31 characters
1/1 test cases complete: 8 passes, 0 fails and 1 exceptions.

Tracker/Visit.test.php

ip addresses again
1/1 test cases complete: 14 passes, 12 fails and 0 exceptions.

Piwik - running 'integration' tests...

Getting a lot of failures from
Expected GIF beacon, got: --- at [/srv/website/piwik/tests/integration/Integration.php line 246]