[oi-dev] Recent /dev a9 repository ?

Udo Grabowski (IMK) udo.grabowski at kit.edu
Wed Jun 24 15:20:17 UTC 2015


Summary of what I've achieved up to now:

   - No, there are no torrentz outside, all you get
     are ad- and malware installers for MS-Doses, so
     just stay away from this harmful stuff (esp. if
     you have a Dose!)

Indeed, my starting point was a way too old StudioExpress
developer 12.0 special release with DLight which was not easily
"up-patchable" to the desired point.

Instead, I've found this: StudioExpress-sol-x86-2009-03-ii.sh,
which is very near the desired patchpoint, but differs from the
original "kernel-build" Studio in having, e.g., a few newer patches for
libsunperf and the like. I then extensively studied Oracles patch
matrices and tested them out to find out that these specific 5
patches are needed to get the C/C++ (yes, there's C++ needed for
the kernel build!) environment very close to the required one:

124864-12 124868-10 124873-07 126496-04 126498-13
(a premium support account for anything suffices to access these)

With these patches, most of the essential stuff has the correct
md5sums. Using ./nightly.sh illumos.sh production with SUN cc/CC
and no shadow gcc, I'm now able to reproduce the exact drivers
for mpt_sas, mr_sas, bge, and a couple of others. My earlier observation
that I only could produce mpt and some other ones was a red herring
since they are not compiled at all, but come from the closed-bins.....
in fact, the objects shouldn't have the exact size and md5sums, since the
date is left in the .comment section (see mcs -p file), so you have to
delete (mcs -d file) this before actually comparing files.
On some others I still see differences (e.g.,mc-amd) in file size,
but the disassemblies are exactly the same, elfdump shows only differences
in e_shoff and some sh_offset entries by a couple of bytes, so I suspect
that one of these has different section alignments. I don't know if
this is a problem, but up to know I'm only planning to use those
drivers for which I can reproduce the exact oi object, hoping that
this is qualification enough to trust an updated version of that
driver.

What still absolutely puzzles me is that the dis command of
the host and that of the build zone (which is the same OS version)
give different output, although the command as well as all
dynamical linked libraries are exactly the same ! This caused
a lot of confusion since first I "dissed" on both and could not
prove equality. I still have no explanation for that (maybe it reads
something elsewhere), but only dis-ing on one circumvents that problem.
So I conclude that maybe the build environment contributes to the
remaining differences I see in the drivers.

Thanks for help so far !

On 19/06/2015 23:25, Jon Tibble wrote:
> Yeah, you've got different and missing binaries:
>
> --- mystudiomd5sums     2015-06-19 22:23:26.507840266 +0100
> +++ udostudiomd5sums    2015-06-19 22:20:02.514366537 +0100
> @@ -1,9 +1,9 @@
> -3265b6e5fea71b80d802b839a6271449  prod/bin/amd64/dbx
> -f3406e01f03dc70dda6111d937d7d147  prod/bin/amd64/dwarfdump
> -57b45df2b1c768089c91c96beccd8444  prod/bin/amd64/er_kernel
> +291efba7feafa0e0c7a4392a962a8c54  prod/bin/amd64/dbx
> +bce85c779015f30de1f649b13e983a93  prod/bin/amd64/dwarfdump
> +15cf5bc6d15504c2bcef6c6d06e69137  prod/bin/amd64/er_kernel
>    d38e359e98294eeac936db6fe68f9190  prod/bin/cc
> -11a514e2911a1cf950957f2ae1d9fe6e  prod/bin/ube
> -9a56841058b0eda6e34e8659f27eb3f7  prod/bin/fbe
> +a8ffc00586be7b3a04195fe2fe4e987c  prod/bin/ube
> +166eaf57e5d21b0ecb98b9336cd73609  prod/bin/fbe
>    ac781f9bdd73518794e5ca769c8c3ce6  prod/lib/CCrti.o
>    6d9a62efc4293a9fb58a11fa9227e63e  prod/lib/CCrtn.o
>    5ff76c1ea546050bc0500564ff054727  prod/lib/bb_link.o
> @@ -19,51 +19,46 @@
>    e7ae10ad47dc9776de4bac6a22f3e346  prod/lib/prof_func.o
>    1b5404db7308f056fe7417ebec2d73ce  prod/lib/prof_lib.o
>    70d444bcf05aca11558a97a1980aab77  prod/lib/prof_tsd.o
> -db9774ca4cb8eec3232641abb1a999fa  prod/lib/unsync_stdio.o
> +8662a745747d517e0e3dda5edb3cf2b4  prod/lib/unsync_stdio.o
>    e5af76c4530a8b62e240347b2ec4169e  prod/lib/values-xa.o
>    9320085eaf289a0e13c94165ca728e16  prod/lib/values-xc.o
>    77bb70c1ce724aeef4f2be283183af9e  prod/lib/values-xi.o
>    df89f1ce3fc7addd9bc93974a8035165  prod/lib/values-xpg4.o
>    5054a233497141647f1464bae5f3c959  prod/lib/values-xs.o
>    1b27c9bcd1ec74f2c45a7e2f292ffc09  prod/lib/values-xt.o
> -ba40d52e5565b76294597c7c2e4b43e1  prod/lib/libCrun.a
> -c46f2d60125b347c7acbdaaf55ddadc2  prod/lib/libCstd.a
> -62e3e8451de16f9fef09aa2d00ab0d21  prod/lib/libCsunimath.a
> -d7aa4ff11fb0d2195255ac5e1d13b050  prod/lib/libCsunimathios.a
> -3beb221642e72ac5baa2056de7b70ebe  prod/lib/libcplxsupp.a
> -4b128e3c1a42bb8bc6f3c8d8287ff1db  prod/lib/libdemangle.a
> -67513c6fdadf246b4f659fce04e02e52  prod/lib/libfai.a
> -b1badd7d564c37c2047168d14cc1b868  prod/lib/libfsu.a
> -0c3a73488b6b0cd01da1588e461e5ceb  prod/lib/libfui.a
> -175b1ecb5415a4606c19575b08187250  prod/lib/libgc.a
> -e46fe2b536f7fe97273ae4dd18bef183  prod/lib/libiostream.a
> -f58df35cb3238029c6a2dc65c4ca1b29  prod/lib/libmopt.a
> -92504fbc12f4ef35ec4608e1feddb0fa  prod/lib/libompstubs.a
> +82bafba3ad7eca72c7426f9614b49fee  prod/lib/libCrun.a
> +025a4220737a89bbd20a374edba0f5d0  prod/lib/libCstd.a
> +92590cd7b186ca3b8e8942805b241257  prod/lib/libcplxsupp.a
> +9ac9f5482e9a001faaca0417f5724eca  prod/lib/libdemangle.a
> +939f5ed15cfff4fd6c63d2c53fdac476  prod/lib/libfai.a
> +2e7731c47e5faab67deaaa2cb801b7c1  prod/lib/libfsu.a
> +c9c3882b79d60310d27fe9352fc13150  prod/lib/libfui.a
> +181f42d43361a85dfedeb0cabadf77f0  prod/lib/libgc.a
> +a10030c4dcc9984dabb332afc412ad4f  prod/lib/libiostream.a
> +3d54232fcc645e5c07d69ba3d9ad6fd1  prod/lib/libmopt.a
> +154fa202068bb7d996f94f1f3f46eac3  prod/lib/libompstubs.a
>    57ab0d8fdefee02c4f2ec7c05add84fe  prod/lib/libsgml.a
> -685002d0efa676bc125028c8d26cc356  prod/lib/libsunmath.a
> -7cdef9d683f1e90ea18585b335a2fb8e  prod/lib/libsunperf.a
> +f862cb0415636dfd32411542e5dff252  prod/lib/libsunmath.a
> +309c87c8fced6b8ea7e718c2d762275d  prod/lib/libsunperf.a
>    d13162b4a85c36f640279b27e353b351  prod/lib/liburl.a
>    71513baeb51ace3a3c351d508f0e0fb5  prod/lib/liburlcpp.a
> -5c342466bee3a3aa9d7dfc11de56bf07  prod/lib/amd64/libCrun.a
> -c7a493acd8a3deb8a9bdcdc6148dc1cb  prod/lib/amd64/libCstd.a
> -f31db33541698c215c0e8586c08786f1  prod/lib/amd64/libCsunimath.a
> -3761f39fbf1fb38813df83705fd61db0  prod/lib/amd64/libCsunimathios.a
> -20271d71ae0414bad8eae219b841e276  prod/lib/amd64/libdemangle.a
> -e154bba0b7675791414c54187fcd1a53  prod/lib/amd64/libfai.a
> -7741c4a5ad439bd2655cde4e2880083e  prod/lib/amd64/libfsu.a
> -6758bbf594e314d8552f107f06821620  prod/lib/amd64/libfui.a
> -fff5f0cb9bc70b1faef2f8e7984d2e51  prod/lib/amd64/libgc_dbg.a
> -1c978717c6d9c470410a4d1a4e422394  prod/lib/amd64/libgc.a
> -bc7d899345421c1c610cb0d89c3cf05e  prod/lib/amd64/libiostream.a
> -61f7555106c360ccbb1aa5c184870ce8  prod/lib/amd64/libmopt.a
> -6d67aaf1c4738914e7774d8eace2db0c  prod/lib/amd64/libompstubs.a
> -e937c699a07b220e94bd1970e91eed85  prod/lib/amd64/libsunimath.a
> -059ba17b3e3926d1f2239991e09840ff  prod/lib/amd64/libsuniperf.a
> -e0a3bbda0a49c6fb2585283fcf537fb9  prod/lib/amd64/libsunmath.a
> -915e2401d4e9d26970eb85d0293a3f6f  prod/lib/amd64/libsunperf.a
> +0b184fd90681eed5d1dc088dece2a98d  prod/lib/amd64/libCrun.a
> +692c0f92ce348687c346fcc3cb5c1bca  prod/lib/amd64/libCstd.a
> +356c8a482012956f164245041e51ad20  prod/lib/amd64/libdemangle.a
> +6e566228e3265a841b87fb4de36e0852  prod/lib/amd64/libfai.a
> +04c820f9321021170dbf4d922b5c90b5  prod/lib/amd64/libfsu.a
> +3e422bcbf448d7f63644590fccc2fd1a  prod/lib/amd64/libfui.a
> +c5d1bff9e633e739e24989e59c2c7de3  prod/lib/amd64/libgc.a
> +48fe527400dbe2c7a58cd8efa0bdc272  prod/lib/amd64/libiostream.a
> +0133b194b7f12be7294e3afbcc09ce03  prod/lib/amd64/libmopt.a
> +f21ba83a7558e865a3394c46e4783b0d  prod/lib/amd64/libompstubs.a
> +611f4c812a16075475679ee7be8e7c68  prod/lib/amd64/libsunimath.a
> +dcc647a94eb34235fcb4f11f3c078f4a  prod/lib/amd64/libsuniperf.a
> +25e829ff48cb21fc075d2a8d735d6591  prod/lib/amd64/libsunmath.a
> +cca117475c53504e44373ffb225d5291  prod/lib/amd64/libsunperf.a
>    513a37e86305124bea6e27f502b0e778  prod/lib/amd64/liburl.a
>    a8b8d64bd660e366705d11d2b3a5ccd1  prod/lib/amd64/liburlcpp.a
> -b72ba1f5a1e3004310d74102134bdf41  prod/lib/amd64/CCrti.o
> +97973121dac7ddd4de9dd271da5209e0  prod/lib/amd64/CCrti.o
>    e64434125c6ecc3199638545b38baf70  prod/lib/amd64/CCrtn.o
>    c8699d26bd63547667fc5e414fee18a5  prod/lib/amd64/bb_link.o
>    635e4c09342cb12608bead1e7fd4ad79  prod/lib/amd64/crt1x.o
> @@ -74,7 +69,7 @@
>    19f720b13373539510175123f5ac8e5b  prod/lib/amd64/pagesize.o
>    980b4d9768bff24675428dcaa9a4a73b  prod/lib/amd64/prof_lib.o
>    3d1dcd25f138ae24c3825236c358f8a8  prod/lib/amd64/prof_tsd.o
> -dad5470f5850053de59c850eeaf6e2af  prod/lib/amd64/unsync_stdio.o
> +bb4d5eed4b1522d14f75c250acdb96ba  prod/lib/amd64/unsync_stdio.o
>    e6da22938ae64ec93fbc393ee1144908  prod/lib/amd64/values-xa.o
>    e5184a80c5fadee16f478741e41356b3  prod/lib/amd64/values-xc.o
>    5412a75dc071fe69058f79461fd36c4f  prod/lib/amd64/values-xi.o
>
>
> On 06/19/2015 21:40, Udo Grabowski (IMK) wrote:
>> Thanks for your answer! The problem is that I supposedly
>> have both of these old compilers, but I still see these
>> differences, so I'm not sure if this is a difference in
>> the compiler (where I really don't know what that should be),
>> or I grabbed the wrong repository (but -sustaining/illumos-gate/)
>> from 6 weeks ago seems to be the right one, so I'm out of
>> explanations, and not sure if I can trust that what is
>> compiled now.
>> Is it possible that you share the md5sums of the critical
>> binaries of Studio12.0 patch 124868-10 2009/04/3, here are mine:
>>
>> md5sum  prod/bin/amd64/*
>> md5sum  prod/bin/cc
>> md5sum  prod/bin/ube
>> md5sum  prod/bin/fbe
>> md5sum  prod/lib/*.o
>> md5sum  prod/lib/*.a
>> md5sum  prod/lib/amd64/*.a
>> md5sum  prod/lib/amd64/*.o
>>
>> -bash-4.0$ md5sum  prod/bin/amd64/*
>> 291efba7feafa0e0c7a4392a962a8c54  prod/bin/amd64/dbx
>> bce85c779015f30de1f649b13e983a93  prod/bin/amd64/dwarfdump
>> 15cf5bc6d15504c2bcef6c6d06e69137  prod/bin/amd64/er_kernel
>>
>> -bash-4.0$ md5sum  prod/bin/cc
>> d38e359e98294eeac936db6fe68f9190  prod/bin/cc
>>
>> -bash-4.0$ md5sum  prod/bin/ube
>> a8ffc00586be7b3a04195fe2fe4e987c  prod/bin/ube
>>
>> -bash-4.0$ md5sum  prod/bin/fbe
>> 166eaf57e5d21b0ecb98b9336cd73609  prod/bin/fbe
>>
>> -bash-4.0$ md5sum  prod/lib/*.o
>> ac781f9bdd73518794e5ca769c8c3ce6  prod/lib/CCrti.o
>> 6d9a62efc4293a9fb58a11fa9227e63e  prod/lib/CCrtn.o
>> 5ff76c1ea546050bc0500564ff054727  prod/lib/bb_link.o
>> cd3798df6876ec7c04b590b9921e4bf7  prod/lib/crt1.o
>> 9b26134b28b015dc93f09d9278b6b7b7  prod/lib/crt1x.o
>> 0043d38a1dcd166eaaf6dffc24ab5710  prod/lib/crti.o
>> 48ddfefb4b9d2cb096e920faadedbc6e  prod/lib/crtn.o
>> d1f511982b21f4f31393f4ecec6f36a9  prod/lib/gcrt1.o
>> 42c977b2dcec7c21fa34fcca816c56c2  prod/lib/gcrt1x.o
>> cd5bcc6c5dd07fa0f23eab1e0e0c000d  prod/lib/mcrt1.o
>> 34e5b8f468bfc989be83188215910820  prod/lib/mcrt1x.o
>> 2a35ef3e10032fef034d50d951440257  prod/lib/pagesize.o
>> e7ae10ad47dc9776de4bac6a22f3e346  prod/lib/prof_func.o
>> 1b5404db7308f056fe7417ebec2d73ce  prod/lib/prof_lib.o
>> 70d444bcf05aca11558a97a1980aab77  prod/lib/prof_tsd.o
>> 8662a745747d517e0e3dda5edb3cf2b4  prod/lib/unsync_stdio.o
>> e5af76c4530a8b62e240347b2ec4169e  prod/lib/values-xa.o
>> 9320085eaf289a0e13c94165ca728e16  prod/lib/values-xc.o
>> 77bb70c1ce724aeef4f2be283183af9e  prod/lib/values-xi.o
>> df89f1ce3fc7addd9bc93974a8035165  prod/lib/values-xpg4.o
>> 5054a233497141647f1464bae5f3c959  prod/lib/values-xs.o
>> 1b27c9bcd1ec74f2c45a7e2f292ffc09  prod/lib/values-xt.o
>>
>> -bash-4.0$ md5sum  prod/lib/*.a
>> 82bafba3ad7eca72c7426f9614b49fee  prod/lib/libCrun.a
>> 025a4220737a89bbd20a374edba0f5d0  prod/lib/libCstd.a
>> 92590cd7b186ca3b8e8942805b241257  prod/lib/libcplxsupp.a
>> 9ac9f5482e9a001faaca0417f5724eca  prod/lib/libdemangle.a
>> 939f5ed15cfff4fd6c63d2c53fdac476  prod/lib/libfai.a
>> 2e7731c47e5faab67deaaa2cb801b7c1  prod/lib/libfsu.a
>> c9c3882b79d60310d27fe9352fc13150  prod/lib/libfui.a
>> 181f42d43361a85dfedeb0cabadf77f0  prod/lib/libgc.a
>> a10030c4dcc9984dabb332afc412ad4f  prod/lib/libiostream.a
>> 3d54232fcc645e5c07d69ba3d9ad6fd1  prod/lib/libmopt.a
>> 154fa202068bb7d996f94f1f3f46eac3  prod/lib/libompstubs.a
>> 57ab0d8fdefee02c4f2ec7c05add84fe  prod/lib/libsgml.a
>> f862cb0415636dfd32411542e5dff252  prod/lib/libsunmath.a
>> 309c87c8fced6b8ea7e718c2d762275d  prod/lib/libsunperf.a
>> d13162b4a85c36f640279b27e353b351  prod/lib/liburl.a
>> 71513baeb51ace3a3c351d508f0e0fb5  prod/lib/liburlcpp.a
>>
>> -bash-4.0$ md5sum  prod/lib/amd64/*.a
>> 0b184fd90681eed5d1dc088dece2a98d  prod/lib/amd64/libCrun.a
>> 692c0f92ce348687c346fcc3cb5c1bca  prod/lib/amd64/libCstd.a
>> 356c8a482012956f164245041e51ad20  prod/lib/amd64/libdemangle.a
>> 6e566228e3265a841b87fb4de36e0852  prod/lib/amd64/libfai.a
>> 04c820f9321021170dbf4d922b5c90b5  prod/lib/amd64/libfsu.a
>> 3e422bcbf448d7f63644590fccc2fd1a  prod/lib/amd64/libfui.a
>> c5d1bff9e633e739e24989e59c2c7de3  prod/lib/amd64/libgc.a
>> 48fe527400dbe2c7a58cd8efa0bdc272  prod/lib/amd64/libiostream.a
>> 0133b194b7f12be7294e3afbcc09ce03  prod/lib/amd64/libmopt.a
>> f21ba83a7558e865a3394c46e4783b0d  prod/lib/amd64/libompstubs.a
>> 611f4c812a16075475679ee7be8e7c68  prod/lib/amd64/libsunimath.a
>> dcc647a94eb34235fcb4f11f3c078f4a  prod/lib/amd64/libsuniperf.a
>> 25e829ff48cb21fc075d2a8d735d6591  prod/lib/amd64/libsunmath.a
>> cca117475c53504e44373ffb225d5291  prod/lib/amd64/libsunperf.a
>> 513a37e86305124bea6e27f502b0e778  prod/lib/amd64/liburl.a
>> a8b8d64bd660e366705d11d2b3a5ccd1  prod/lib/amd64/liburlcpp.a
>>
>> -bash-4.0$ md5sum  prod/lib/amd64/*.o
>> 97973121dac7ddd4de9dd271da5209e0  prod/lib/amd64/CCrti.o
>> e64434125c6ecc3199638545b38baf70  prod/lib/amd64/CCrtn.o
>> c8699d26bd63547667fc5e414fee18a5  prod/lib/amd64/bb_link.o
>> 635e4c09342cb12608bead1e7fd4ad79  prod/lib/amd64/crt1x.o
>> 4db83f7a1d2f951ce3eacee117cd53f4  prod/lib/amd64/crti.o
>> 10e6941b9f1c9c655f2cd6d17afa89e4  prod/lib/amd64/crtn.o
>> 6d8cd9598fabcbcaa2b52b3b28bf949a  prod/lib/amd64/gcrt1x.o
>> e6852dadd381f0c9ca83441444d73c27  prod/lib/amd64/mcrt1x.o
>> 19f720b13373539510175123f5ac8e5b  prod/lib/amd64/pagesize.o
>> 980b4d9768bff24675428dcaa9a4a73b  prod/lib/amd64/prof_lib.o
>> 3d1dcd25f138ae24c3825236c358f8a8  prod/lib/amd64/prof_tsd.o
>> bb4d5eed4b1522d14f75c250acdb96ba  prod/lib/amd64/unsync_stdio.o
>> e6da22938ae64ec93fbc393ee1144908  prod/lib/amd64/values-xa.o
>> e5184a80c5fadee16f478741e41356b3  prod/lib/amd64/values-xc.o
>> 5412a75dc071fe69058f79461fd36c4f  prod/lib/amd64/values-xi.o
>> 833b10f09ccdda3061c4175da523a52a  prod/lib/amd64/values-xpg4.o
>> 62b66f90fede853f6178cf6a14e74c12  prod/lib/amd64/values-xs.o
>> 93f2a02ed698e39e350a7d8415b5fb6b  prod/lib/amd64/values-xt.o
>>
>>
>> On 19/06/2015 20:51, Jon Tibble wrote:
>>> Hi,
>>>
>>> On 06/19/2015 16:27, Jonathan Adams wrote:
>>>> Only replying to let you know that your messages _are_ getting to the
>>>> list
>>>> ... Sorry, I don't know the answer.
>>>>
>>>> Jon
>>>>
>>>> On 19 June 2015 at 09:51, Udo Grabowski (IMK) <udo.grabowski at kit.edu>
>>>> wrote:
>>>>
>>>>> Hi again,
>>>>>
>>>>> (I really hate it to reply to my own posts, but there seems
>>>>> to be no one else left willing to reply...)
>>>>>
>>>>> Amojng the numerous different older and newer pages on how
>>>>> to compile illumos or OI with or without gcc or Sun cc and
>>>>> with this or that version I found this page today where
>>>>> SunStudio 12.3 is mentioned as the compiler now to be
>>>>> used (when stuck with Sun cc):
>>>>> <http://wiki.openindiana.org/oi/Building+with+oi-build>
>>>>>
>>>>> Can anybody confirm that this is the version oi_151a9 was
>>>>> built with ? Or can anybody tell me if there's a trace of
>>>>> the compiler version left in any of the binaries on oi_151a9 ?
>>>>>
>>>
>>> /dev is built with the proper patched SunStudios that are no longer
>>> available for download or free to distribute.
>>> This is why hipster is switching everything to GCC.
>>>
>>> I think that page you've mentioned that lists 12.3 is only concerned
>>> with the oi-build/userland stuff as I'm not aware of any publicly
>>> available studio that can build illumos.
>>> See this page that is clear about SunStudio versions for illumos:
>>> http://wiki.illumos.org/display/illumos/How+To+Build+illumos
>>>
>>> JT


-- 
Dr.Udo Grabowski   Inst.f.Meteorology & Climate Research IMK-ASF-SAT
http://www.imk-asf.kit.edu/english/sat.php
KIT - Karlsruhe Institute of Technology           http://www.kit.edu
Postfach 3640,76021 Karlsruhe,Germany T:(+49)721 608-26026 F:-926026

-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 5285 bytes
Desc: S/MIME Cryptographic Signature
URL: <http://openindiana.org/pipermail/oi-dev/attachments/20150624/dd40b402/attachment-0002.bin>


More information about the oi-dev mailing list