[oi-dev] Improving file transfer speed on ZFS

[Atiq Rahman]

@Stephan 

```
rsync --archive --human-readable --info=progress2 source dst
```

@toomas USB3

@Peter could be the compression, I will check next time.



On Mon, Nov 3, 2025 at 11:06 PM Stephan Althaus via oi-dev <oi-dev at openindiana.org> wrote:
 > 
 > On 11/4/25 05:03, Atiq Rahman wrote:
 > Hi,
 > When I am copying over files to the zfs dataset on an external HDD, the speed is one third of what it is over exFAT. This is zfs to zfs copy which is basically way slower than zfs to exFAT.
 > 
 > This was my zpool create command on the external drive,
 > 
 > ```
 > zpool create -o ashift=12 -O compression=lz4 -o autotrim=off -O mountpoint=none -O atime=off -O dnodesize=auto hyperspace /dev/dsk/c4t0d0
 > ```
 > 
 > And, this is how the dataset was created:
 > 
 > ```
 > zfs create -o recordsize=1M -o normalization=formD -O mountpoint=/media hyperspace/media
 > ```
 > 
 > I know zfs has journaling overhead. But, is it possible to set certain zfs properties to improve the transfer speed?
 > 
 > Hello Atiq!
 > 
 > How do you copy, please show the commands (?)
 > 
 > You may want to investigate the read speed with something like zfs send ... > /dev/null
 > 
 > If you do a zfs send -> receive, a buffer like "mbuffer" may help, over network pathes in combination with a compression pbzip2, pigz ...
 > 
 > 
 > 
 > Regards,
 >  > Stephan
 > 
 > 
 > Hello Atiq!
 > 
 > How do you copy, please show the commands (?)
 > 
 > You may want to investigate the read speed with something like zfs send ... > /dev/null
 > 
 > If you do a zfs send -> receive, a buffer like "mbuffer" may help, over network pathes in combination with a compression pbzip2, pigz ...
 > 
 > 
 > 
 > Regards,
 > 
 > Stephan
 > 
 > If its external HDD, which interface? usb3?
 > 
 > rgds,
 > toomas > 
 > 
 > 
 > On Tue, Nov 4, 2025 at 12:54 AM Peter Tribble <peter.tribble at gmail.com> wrote:
 >  > Journaling normally speeds things up.
 > But generally I would start with using the defaults (except compression), other settings generally
 > only come into play in specialist cases.
 >  
 > 
 > 
 > --
 > -Peter Tribble
 > http://www.petertribble.co.uk/ - http://ptribble.blogspot.com/
 > _______________________________________________
 > oi-dev mailing list
 > oi-dev at openindiana.org
 > https://openindiana.org/mailman/listinfo/oi-dev
 >