[OpenIndiana-discuss] Privoxy 3.0.19 gets very bogged down on OpenIndiana 151a2

[John Wiegley]

Hello,

I'm not sure whether this is a Privoxy issue, or an OpenIndiania issue.  The
webpage in question is this particularly badly-behaved site:

  http://www.bestbeefjerky.org/2011/04/bacon-forever-smoky-original.html

For whatever reason, this site will generate an endless stream of connections,
hammering Privoxy very hard.

With the Privoxy 3.0.8 that you get from "pkg install privoxy", this site
causes no performance problems.  Privoxy stays at <1% CPU.  But when I build
3.0.19 from source, it causes CPU utilization from Privoxy to climb into the
50-60% range, and to stay there for several minutes, long after I quit my
browser.

I turned on lots of debug output in the Privoxy log (connections, I/O, data),
and didn't see anything abnormal during this CPU spike.  In fact, CPU was
holding at 42% while nothing additional was getting written to the log.

Switching to truss, I saw thousands and thousands of calls to lwp_pack and
lwp_unpack, over and over, which didn't stop until the CPU quieted down.

Here is how I configured Privoxy for OI:

  ./configure --prefix=/usr --sysconfdir=/etc/privoxy --localstatedir=/var \
  CFLAGS='-O3 -pipe -fomit-frame-pointer -funroll-loops -ffast-math -fno-exceptions' \
  --enable-compression --with-user=webservd --with-group=webservd

Does this ring any bells for anyone?  I'm back to using 3.0.8, but am curious
as to why I couldn't upgrade to 3.0.19.

Thanks,
  John