[oi-dev] python biz

Richard PALO richard at netbsd.org
Wed Dec 30 18:37:48 UTC 2015


Took the dive to update an oi_151a9 system to oi-hipster(2015) and things seems to be going okay:-)

I'm on the python upgrade part, taking advantage of the migration to do 2.6=>2.7 at the same time.

I notice that there are a number python packages somewhat out of date, I've come across a package called 'yolk3k'
which seems quite a nice tool to deal with, installed with pip-2.7.  For example:

> richard at smicro:~$ yolk -l
> Babel           - 1.3          - active 
> CherryPy        - 3.1.2        - active development (/usr/lib/python2.7/vendor-packages)
> Jinja2          - 2.7.3        - active 
> M2Crypto        - 0.21.1       - active development (/usr/lib/python2.7/vendor-packages)
> Mako            - 1.0.0        - active 
> MarkupSafe      - 0.23         - active 
> MySQL-python    - 1.2.2        - active development (/usr/lib/python2.7/vendor-packages)
> PIL             - 1.1.7        - active development (/usr/lib/python2.7/vendor-packages/PIL)
> Pillow          - 2.5.1        - active 
> PyYAML          - 3.11         - active development (/usr/lib/python2.7/vendor-packages)
> Pyrex           - 0.9.9        - active development (/usr/lib/python2.7/vendor-packages)
> Pyro            - 3.9.1        - active development (/usr/lib/python2.7/vendor-packages)
> Pyro4           - 4.22         - active development (/usr/lib/python2.7/vendor-packages)
> Python-Chart    - 1.39         - active 
> Python          - 2.7.11       - active development (/usr/lib/python2.7/lib-dynload)
> ScientificPython - 2.8          - active development (/usr/lib/python2.7/vendor-packages)
> Twisted Web2    - 8.1.0        - active development (/usr/lib/python2.7/vendor-packages)
> Twisted         - 10.1.0       - active development (/usr/lib/python2.7/vendor-packages)
> Werkzeug        - 0.9.6        - active 
> argh            - 0.24.1       - active development (/usr/lib/python2.7/vendor-packages)
> argparse        - 1.2.1        - active 
> coverage        - 3.5          - active development (/usr/lib/python2.7/vendor-packages)
> cssutils        - 0.9.6        - active development (/usr/lib/python2.7/vendor-packages)
> cups            - 1.0          - active development (/usr/lib/python2.7/vendor-packages)
> decorator       - 3.4.0        - active development (/usr/lib/python2.7/vendor-packages)
> docutils        - 0.12         - active development (/usr/lib/python2.7/vendor-packages)
> dulwich         - 0.9.5        - active development (/usr/lib/python2.7/vendor-packages)
> feedparser      - 5.1.3        - active 
> gdata           - 2.0.18       - active 
> gevent          - 1.0.2        - active 
> greenlet        - 0.4.7        - active 
> instant         - 1.3.0        - active development (/usr/lib/python2.7/vendor-packages)
> ipython         - 1.1.0        - active development (/usr/lib/python2.7/vendor-packages)
> jcconv          - 0.2.3        - active 
> jsonrpclib      - 0.1.3        - active development (/usr/lib/python2.7/vendor-packages)
> jsonschema      - 2.4.0        - active development (/usr/lib/python2.7/vendor-packages)
> logilab-astng   - 0.24.0       - active development (/usr/lib/python2.7/vendor-packages)
> logilab-common  - 0.58.2       - active development (/usr/lib/python2.7/vendor-packages)
> lxml            - 3.3.5        - active 
> mercurial       - 3.4.2        - active development (/usr/lib/python2.7/vendor-packages)
> mock            - 1.0.1        - active development (/usr/lib/python2.7/vendor-packages)
> netaddr         - 0.7.10       - active development (/usr/lib/python2.7/vendor-packages)
> netsnmp-python  - 1.0a1        - active development (/usr/lib/python2.7/vendor-packages)
> nose            - 1.2.1        - active development (/usr/lib/python2.7/vendor-packages)
> numpy           - 1.8.2        - active development (/usr/lib/python2.7/vendor-packages)
> passlib         - 1.6.2        - active 
> pep8            - 1.4.6        - active development (/usr/lib/python2.7/vendor-packages)
> pip             - 1.4.1        - active development (/usr/lib/python2.7/vendor-packages)
> pkg             - 0.1          - active development (/usr/lib/python2.7/vendor-packages)
> ply             - 3.1          - active development (/usr/lib/python2.7/vendor-packages)
> psutil          - 2.1.1        - active 
> psycogreen      - 1.0          - active 
> psycopg2        - 2.5.3        - active 
> pyOpenSSL       - 0.13         - active development (/usr/lib/python2.7/vendor-packages)
> pyPdf           - 1.13         - active 
> pybonjour       - 1.1.1        - active development (/usr/lib/python2.7/vendor-packages)
> pycparser       - 2.10         - active development (/usr/lib/python2.7/vendor-packages)
> pycurl          - 7.19.0       - active development (/usr/lib/python2.7/vendor-packages)
> pydot           - 1.0.2        - active 
> pylint          - 0.25.2       - active development (/usr/lib/python2.7/vendor-packages)
> pyparsing       - 1.5.7        - active 
> pyserial        - 2.7          - active 
> python-dateutil - 1.5          - active development (/usr/lib/python2.7/vendor-packages)
> python-memcached - 1.53         - active development (/usr/lib/python2.7/vendor-packages)
> python-openid   - 2.2.5        - active 
> python-stdnum   - 1.2          - active 
> pytz            - 2014.4       - active 
> pyusb           - 1.0.0b1      - active 
> pyxdg           - 0.25         - active development (/usr/lib/python2.7/vendor-packages)
> pyzmq           - 14.0.1       - active development (/usr/lib/python2.7/vendor-packages)
> qrcode          - 5.0.1        - active 
> reportlab       - 3.1.44       - active 
> requests        - 2.6.0        - active 
> setuptools      - 0.6c11       - active development (/usr/lib/python2.7/vendor-packages)
> simplejson      - 3.5.3        - active 
> six             - 1.7.3        - active 
> tornado         - 2.4.1        - active development (/usr/lib/python2.7/vendor-packages)
> unittest2       - 0.5.1        - active development (/usr/lib/python2.7/vendor-packages)
> vatnumber       - 1.2          - active 
> vobject         - 0.6.6        - active 
> wsgiref         - 0.1.2        - active development (/usr/lib/python2.7)
> xlwt            - 0.7.5        - active 
> yolk3k          - 0.8.8        - active 
> zope.interface  - 3.3.0        - active development (/usr/lib/python2.7/vendor-packages)

(NB wsgiref seem missplaced and simplejson isn't noticed from vendor-packages)

ahh, after a `pip-27 uninstall simplejson` I noticed a lot of errors with `pkg verify simplejson-27` 
that `pkg fix` corrected. btw, I guess perhaps the upgrade bypassed some tests, as pkg verify library/python-2/*
finds quite a bit to fix... 

> richard at smicro:~$ yolk -l 
> Babel           - 1.3          - active 
> CherryPy        - 3.1.2        - active development (/usr/lib/python2.7/vendor-packages)
> Jinja2          - 2.7.2        - non-active development (/usr/lib/python2.7/vendor-packages)
> Jinja2          - 2.7.3        - active 
> M2Crypto        - 0.21.1       - active development (/usr/lib/python2.7/vendor-packages)
> Mako            - 0.4.1        - non-active development (/usr/lib/python2.7/vendor-packages)
> Mako            - 1.0.0        - active 
> MarkupSafe      - 0.18         - non-active development (/usr/lib/python2.7/vendor-packages)
> MarkupSafe      - 0.23         - active 
> MySQL-python    - 1.2.2        - active development (/usr/lib/python2.7/vendor-packages)
> PIL             - 1.1.7        - active development (/usr/lib/python2.7/vendor-packages/PIL)
> Pillow          - 2.5.1        - active 
> PyYAML          - 3.11         - active development (/usr/lib/python2.7/vendor-packages)
> Pyrex           - 0.9.9        - active development (/usr/lib/python2.7/vendor-packages)
> Pyro            - 3.9.1        - active development (/usr/lib/python2.7/vendor-packages)
> Pyro4           - 4.22         - active development (/usr/lib/python2.7/vendor-packages)
> Python-Chart    - 1.39         - active 
> Python          - 2.7.11       - active development (/usr/lib/python2.7/lib-dynload)
> ScientificPython - 2.8          - active development (/usr/lib/python2.7/vendor-packages)
> Twisted Web2    - 8.1.0        - active development (/usr/lib/python2.7/vendor-packages)
> Twisted         - 10.1.0       - active development (/usr/lib/python2.7/vendor-packages)
> Werkzeug        - 0.9.6        - active 
> argh            - 0.24.1       - active development (/usr/lib/python2.7/vendor-packages)
> argparse        - 1.2.1        - active 
> coverage        - 3.5          - active development (/usr/lib/python2.7/vendor-packages)
> cssutils        - 0.9.6        - active development (/usr/lib/python2.7/vendor-packages)
> cups            - 1.0          - active development (/usr/lib/python2.7/vendor-packages)
> decorator       - 3.4.0        - active development (/usr/lib/python2.7/vendor-packages)
> docutils        - 0.12         - active development (/usr/lib/python2.7/vendor-packages)
> dulwich         - 0.9.5        - active development (/usr/lib/python2.7/vendor-packages)
> feedparser      - 5.1.3        - active 
> gdata           - 2.0.18       - active 
> gevent          - 1.0.2        - active 
> greenlet        - 0.4.7        - active 
> instant         - 1.3.0        - active development (/usr/lib/python2.7/vendor-packages)
> ipython         - 1.1.0        - active development (/usr/lib/python2.7/vendor-packages)
> jcconv          - 0.2.3        - active 
> jsonrpclib      - 0.1.3        - active development (/usr/lib/python2.7/vendor-packages)
> jsonschema      - 2.4.0        - active development (/usr/lib/python2.7/vendor-packages)
> logilab-astng   - 0.24.0       - active development (/usr/lib/python2.7/vendor-packages)
> logilab-common  - 0.58.2       - active development (/usr/lib/python2.7/vendor-packages)
> lxml            - 2.3.3        - non-active development (/usr/lib/python2.7/vendor-packages)
> lxml            - 3.3.5        - active 
> mercurial       - 3.4.2        - active development (/usr/lib/python2.7/vendor-packages)
> mock            - 1.0.1        - active development (/usr/lib/python2.7/vendor-packages)
> netaddr         - 0.7.10       - active development (/usr/lib/python2.7/vendor-packages)
> netsnmp-python  - 1.0a1        - active development (/usr/lib/python2.7/vendor-packages)
> nose            - 1.2.1        - active development (/usr/lib/python2.7/vendor-packages)
> numpy           - 1.8.2        - active development (/usr/lib/python2.7/vendor-packages)
> passlib         - 1.6.2        - active 
> pep8            - 1.4.6        - active development (/usr/lib/python2.7/vendor-packages)
> pip             - 1.4.1        - active development (/usr/lib/python2.7/vendor-packages)
> pkg             - 0.1          - active development (/usr/lib/python2.7/vendor-packages)
> ply             - 3.1          - active development (/usr/lib/python2.7/vendor-packages)
> psutil          - 2.1.1        - active 
> psycogreen      - 1.0          - active 
> psycopg2        - 2.5.2        - non-active development (/usr/lib/python2.7/vendor-packages)
> psycopg2        - 2.5.3        - active 
> pyOpenSSL       - 0.13         - active development (/usr/lib/python2.7/vendor-packages)
> pyPdf           - 1.13         - active 
> pybonjour       - 1.1.1        - active development (/usr/lib/python2.7/vendor-packages)
> pycparser       - 2.10         - active development (/usr/lib/python2.7/vendor-packages)
> pycurl          - 7.19.0       - active development (/usr/lib/python2.7/vendor-packages)
> pydot           - 1.0.2        - active 
> pylint          - 0.25.2       - active development (/usr/lib/python2.7/vendor-packages)
> pyparsing       - 1.5.7        - active 
> pyserial        - 2.7          - active 
> python-dateutil - 1.5          - active development (/usr/lib/python2.7/vendor-packages)
> python-memcached - 1.53         - active development (/usr/lib/python2.7/vendor-packages)
> python-openid   - 2.2.5        - active 
> python-stdnum   - 1.2          - active 
> pytz            - 2014.4       - active 
> pyusb           - 1.0.0b1      - active 
> pyxdg           - 0.25         - active development (/usr/lib/python2.7/vendor-packages)
> pyzmq           - 14.0.1       - active development (/usr/lib/python2.7/vendor-packages)
> qrcode          - 5.0.1        - active 
> reportlab       - 3.1.44       - active 
> requests        - 2.6.0        - active 
> setuptools      - 0.6c11       - active development (/usr/lib/python2.7/vendor-packages)
> simplejson      - 3.6.5        - active development (/usr/lib/python2.7/vendor-packages)
> six             - 1.7.3        - active 
> tornado         - 2.4.1        - active development (/usr/lib/python2.7/vendor-packages)
> unittest2       - 0.5.1        - active development (/usr/lib/python2.7/vendor-packages)
> vatnumber       - 1.2          - active 
> vobject         - 0.6.6        - active 
> wsgiref         - 0.1.2        - active development (/usr/lib/python2.7)
> xlwt            - 0.7.5        - active 
> yolk3k          - 0.8.8        - active 
> zope.interface  - 3.3.0        - active development (/usr/lib/python2.7/vendor-packages)

and to see further update status (of both vendor and site packages, unfortunately mixed)
> richard at smicro:~$ yolk -U
> Babel 1.3 (2.1.1)                                                                                                                                                               
> CherryPy 3.1.2 (4.0.0)
> Jinja2 2.7.3 (2.8)
> M2Crypto 0.21.1 (0.22.6rc4)
> Mako 1.0.0 (1.0.3)
> MySQL-python 1.2.2 (1.2.5)
> Pillow 2.5.1 (3.0.0)
> Pyro 3.9.1 (3.16)
> Pyro4 4.22 (4.41)
> Twisted 10.1.0 (15.5.0)
> Werkzeug 0.9.6 (0.11.3)
> argh 0.24.1 (0.26.1)
> argparse 1.2.1 (1.4.0)
> coverage 3.5 (4.0.3)
> cssutils 0.9.6 (1.0.1)
> decorator 3.4.0 (4.0.6)
> dulwich 0.9.5 (0.12.0)
> feedparser 5.1.3 (5.2.1)
> gevent 1.0.2 (1.1rc2)
> greenlet 0.4.7 (0.4.9)
> instant 1.3.0 (1.5.0)
> ipython 1.1.0 (4.0.1)
> jsonrpclib 0.1.3 (0.1.7)
> jsonschema 2.4.0 (2.5.1)
> logilab-astng 0.24.0 (0.24.3)
> logilab-common 0.58.2 (1.1.0)
> lxml 3.3.5 (3.5.0)
> Mercurial 3.4.2 (3.6.2)
> mock 1.0.1 (1.3.0)
> netaddr 0.7.10 (0.7.18)
> nose 1.2.1 (1.3.7)
> numpy 1.8.2 (1.10.2)
> passlib 1.6.2 (1.6.5)
> pep8 1.4.6 (1.6.2)
> pip 1.4.1 (7.1.2)
> ply 3.1 (3.8)
> psutil 2.1.1 (3.3.0)
> psycopg2 2.5.3 (2.6.1)
> pyOpenSSL 0.13 (0.15.1)
> pycparser 2.10 (2.14)
> pycurl 7.19.0 (7.19.5.3)
> pydot 1.0.2 (1.0.28)
> pylint 0.25.2 (1.5.2)
> pyparsing 1.5.7 (2.0.6)
> pyserial 2.7 (3.0)
> python-dateutil 1.5 (2.4.2)
> python-memcached 1.53 (1.57)
> pytz 2014.4 (2015.7)
> pyusb 1.0.0b1 (1.0.0b2)
> pyzmq 14.0.1 (15.1.0)
> qrcode 5.0.1 (5.1)
> reportlab 3.1.44 (3.2.0)
> requests 2.6.0 (2.9.1)
> setuptools 0.6c11 (19.2)
> simplejson 3.6.5 (3.8.1)
> six 1.7.3 (1.10.0)
> tornado 2.4.1 (4.3)
> unittest2 0.5.1 (1.1.0)
> vobject 0.6.6 (0.8.1c)
> xlwt 0.7.5 (1.0.0)
> zope.interface 3.3.0 (4.1.3)

Might be nice to see what packages are generally used in the OI community that could be pulled
in to vendor-packages...

I'd at least like to see psutil and pytz make it in, if not yolk3k too.

-- 
Richard PALO






More information about the oi-dev mailing list