[oi-dev] IPS switch to Apache 2.4

[Alexander Pyhalov]

Hi there.

I've just merged https://github.com/OpenIndiana/pkg5/pull/31 ,
based on 
https://hg.openindiana.org/upstream/oracle/pkg-gate/rev/9924b63b337c45f805e3ef724831938fd2daa870 
,
which switches IPS depotd and sysrepo to Apache 2.4.

Note, that sysrepo/zoneproxy combination doesn't work on OI anyway due 
to some issue in GZ/NGZ communications. (Volunteers are welcome to debug 
the issue).

At least I've ensured that there's no regressions in IPS testsuite.
To run it, you should build/install pkg and in GZ run
'python run.py -a /tmp/ -v' in
components/openindiana/pkg/pkg/src/tests
After this data from all failed tests will be saved in /tmp/$PID.

While looking at IPS I've
a) fixed several issues in IPS test suit itself (we missed some things 
after update to Python 2.7),
b) found out that we miss M2Crypto patch, necessary for IPS to work with 
CRLs,
c) imported some patches from solaris-userland, which fix different 
Apache 2.4 issues on Solaris.

Note that most test_crl* errors in test suite were related to missing 
m2crypto patch. Also set of tests fail due to expired SSL certs in pkg5 
repository, some fail because we don't ship python 3.4 IPS modules, and 
of course, some of these are actual errors (for example, 
TestPkgSign.test_crl_8), which I couldn't immediately fix :). One common 
class of the errors is related to json parsing and unicode string/usual 
strings conversion.

Test sute results:

before switch to apache 2.4:

# Ran 1045 tests in 10236.876s - skipped 1 tests.
Skipped tests:
cli.t_pkg_help.py TestPkgHelp.test_help_character_encoding: Test 
Skipped: The test system must have the ja_JP.eucJP locale installed to 
run this test.

FAILED (successes=1015, failures=22, errors=8, mismatches=30)

======================================================================
BASELINE MISMATCH: The following results didn't match the baseline.
----------------------------------------------------------------------
api.t_p5p.py TestP5P.test_05_invalid: error
cli.t_pkgsign.py TestPkgSign.test_crl_0: error
cli.t_pkgsign.py TestPkgSign.test_crl_1: fail
cli.t_pkgsign.py TestPkgSign.test_crl_2: error
cli.t_pkgsign.py TestPkgSign.test_crl_3: error
cli.t_pkgsign.py TestPkgSign.test_crl_5: error
cli.t_pkgsign.py TestPkgSign.test_crl_6: error
cli.t_pkgsign.py TestPkgSign.test_crl_8: fail
cli.t_pkgdep.py TestPkgdepBasics.test_PEP_3149: fail
cli.t_pkgdep.py TestPkgdepBasics.test_bug_11805: error
cli.t_pkgdep.py TestPkgdepBasics.test_bug_13059: fail
cli.t_pkgdep.py TestPkgdepBasics.test_output: error
cli.t_pkgdep.py TestPkgdepBasics.test_python_combinations: error
cli.t_pkg_sysrepo.py TestSysrepo.test_11_https_repos: fail
cli.t_pkg_sysrepo.py TestSysrepo.test_11a_https_repos: fail
cli.t_pkg_publisher.py TestPkgPublisherBasics.test_missing_perms: fail
cli.t_pkg_publisher.py TestPkgPublisherBasics.test_publisher_bad_opts: fail
cli.t_pkg_publisher.py 
TestPkgPublisherBasics.test_remove_unused_cert_key: fail
cli.t_pkg_info.py TestPkgInfoBasics.test_ranked: fail
cli.t_pkg_linked.py TestPkgLinkedRecurse.test_recursive_facet: fail
cli.t_pkg_linked.py TestPkgLinkedRecurse.test_recursive_variant: fail
cli.t_pkg_refresh.py 
TestPkgRefreshMulti.test_refresh_certificate_problems: fail
cli.t_pkg_publisher.py TestPkgPublisherMany.test_set_mirrors_origins: fail
cli.t_https.py TestHTTPS.test_01_basics: fail
cli.t_https.py TestHTTPS.test_correct_cert_validation: fail
cli.t_https.py TestHTTPS.test_expired_certs: fail
cli.t_https.py TestHTTPS.test_expiring_certs: fail
cli.t_https.py TestDepotHTTPS.test_01_basics: fail
cli.t_pkgrecv.py TestPkgrecvHTTPS.test_01_basics: fail
cli.t_pkgrepo.py TestPkgrepoHTTPS.test_01_basics: fail
cli.t_pkgsend.py TestPkgsendHTTPS.test_01_basics: fail
----------------------------------------------------------------------


after switch to Apache 2.4 (and related fixes):
# Ran 1045 tests in 9646.154s - skipped 1 tests.
Skipped tests:
cli.t_pkg_help.py TestPkgHelp.test_help_character_encoding: Test 
Skipped: The te
st system must have the ja_JP.eucJP locale installed to run this test.

FAILED (successes=1021, failures=21, errors=3, mismatches=24)

======================================================================
BASELINE MISMATCH: The following results didn't match the baseline.
----------------------------------------------------------------------
cli.t_pkg_sysrepo.py TestSysrepo.test_11_https_repos: fail
cli.t_pkg_sysrepo.py TestSysrepo.test_11a_https_repos: fail
cli.t_pkg_linked.py TestPkgLinkedRecurse.test_recursive_facet: fail
cli.t_pkg_linked.py TestPkgLinkedRecurse.test_recursive_variant: fail
cli.t_pkgsign.py TestPkgSign.test_crl_8: fail
cli.t_pkg_info.py TestPkgInfoBasics.test_ranked: fail
cli.t_pkg_publisher.py TestPkgPublisherBasics.test_missing_perms: fail
cli.t_pkg_publisher.py TestPkgPublisherBasics.test_publisher_bad_opts: fail
cli.t_pkg_publisher.py 
TestPkgPublisherBasics.test_remove_unused_cert_key: fail
cli.t_pkg_publisher.py TestPkgPublisherMany.test_set_mirrors_origins: fail
cli.t_pkg_refresh.py 
TestPkgRefreshMulti.test_refresh_certificate_problems: fail
cli.t_pkgdep.py TestPkgdepBasics.test_PEP_3149: fail
cli.t_pkgdep.py TestPkgdepBasics.test_bug_11805: error
cli.t_pkgdep.py TestPkgdepBasics.test_bug_13059: fail
cli.t_pkgdep.py TestPkgdepBasics.test_output: error
cli.t_pkgdep.py TestPkgdepBasics.test_python_combinations: error
cli.t_https.py TestHTTPS.test_01_basics: fail
cli.t_https.py TestHTTPS.test_correct_cert_validation: fail
cli.t_https.py TestHTTPS.test_expired_certs: fail
cli.t_https.py TestHTTPS.test_expiring_certs: fail
cli.t_pkgrecv.py TestPkgrecvHTTPS.test_01_basics: fail
cli.t_pkgrepo.py TestPkgrepoHTTPS.test_01_basics: fail
cli.t_https.py TestDepotHTTPS.test_01_basics: fail
cli.t_pkgsend.py TestPkgsendHTTPS.test_01_basics: fail
----------------------------------------------------------------------

-- 
Best regards,
Alexander Pyhalov,
system administrator of Southern Federal University IT department