[OpenIndiana-discuss] Useful tidbit for ZFS backup via ZFS Send

Martin Bochnig martin at martux.org
Sat Sep 29 17:42:59 UTC 2012


On Sat, Sep 29, 2012 at 3:46 PM, Bryan N Iotti
<ironsides.medvet at gmail.com> wrote:
[SNIP]
> I searched online for a multithreaded version and came across pigz
> (http://www.zlib.net/pigz/). I downloaded it, modified the Makefile to use
> the Solaris Studio 12.3 cc with the proper CFLAGS ("-fast", for now, no
> -m64). I then copied both pigz and unpigz to a directory in my PATH and
> modified the last command to:
> - zfs send -R rpool@<DATE> | /usr/local/bin/pigz > rpool.COMPLETE.<DATE>.gz
>
> Now backups are compressed using multiple threads and the process takes
> about a quarter of the time.
>
> Pigz apparently splits the input into blocks of a user definable size (128kb
> being the default) and allows for parallel compression, using all available
> threads (or less, with the user -p #threads option).
>
> Hope this helps some of you. Would be nice to have in the pkg repo.
>
> Bryan



Hi Bryan,


thank you for sharing this!
Very interesting. It shall help a lot.
Especially on older multisocket systems like on Ultra 80, it will
probably make a substantial difference.



-
regards,
   %martin



More information about the OpenIndiana-discuss mailing list