[OpenIndiana-discuss] Disk Space Disappearing.
Jim Klimov
jimklimov at cos.ru
Wed Jul 30 10:49:18 UTC 2014
30 июля 2014 г. 9:58:34 CEST, "Dormition Skete (Hotmail)" <dormitionskete at hotmail.com> пишет:
>Could somebody please tell me where in the world all my disk space is
>disappearing to?
>
>On the 23rd, I had 33G free. The next day, I had 22G. The following
>day, I had 11G.
>
>If this happens again, I’m going to be out of disk space!
>
>Can somebody please tell me what in the world might be going on? And
>how to troubleshoot it?
>
>This is primarily an email server for four people. We simply don’t get
>11G of email in a day! Something has to be going wrong here.
>
>Any help will be GREATLY appreciated...
>
>
>========================================================================================================
>
>Wed Jul 23 03:32:59 MDT 2014
>
>*************************************************
>*************************************************
>Disk usage:
>Filesystem size used avail capacity Mounted on
>rpool/ROOT/OpenIndiana-151a7-2014-0706A 134G 3.9G 33G 11%
>/
>/devices 0K 0K 0K 0% /devices
>/dev 0K 0K 0K 0% /dev
>ctfs 0K 0K 0K 0% /system/contract
>proc 0K 0K 0K 0% /proc
>mnttab 0K 0K 0K 0% /etc/mnttab
>swap 7.9G 396K 7.9G 1% /etc/svc/volatile
>objfs 0K 0K 0K 0% /system/object
>sharefs 0K 0K 0K 0% /etc/dfs/sharetab
>/usr/lib/libc/libc_hwcap1.so.1 37G 3.9G 33G 11%
>/lib/libc.so.1
>fd 0K 0K 0K 0% /dev/fd
>swap 7.9G 20K 7.9G 1% /tmp
>swap 7.9G 92K 7.9G 1% /var/run
>rpool/export 134G 32K 33G 1% /export
>rpool/export/home 134G 32K 33G 1% /export/home
>rpool/export/home/dsadmin 134G 1.7G 33G 5%
>/export/home/dsadmin
>rpool 134G 46K 33G 1% /rpool
>rpool/zones 134G 37K 33G 1% /zones
>rpool/zones/archive 134G 34K 33G 1% /zones/archive
>rpool/zones/mysql 134G 33K 33G 1% /zones/mysql
>rpool/zones/routerb2 134G 33K 33G 1% /zones/routerb2
>rpool/zones/tomcat 134G 33K 33G 1% /zones/tomcat
>rpool/zones/webphp4 134G 33K 33G 1% /zones/webphp4
>rpool/zones/mysql/ROOT/zbe-2 134G 940M 33G 3%
>/zones/mysql/root
>rpool/zones/archive/ROOT/zbe-2 134G 28G 33G 46%
>/zones/archive/root
>rpool/zones/routerb2/ROOT/zbe-2 134G 8.9G 33G 22%
>/zones/routerb2/root
>rpool/zones/tomcat/ROOT/zbe-2 134G 827M 33G 3%
>/zones/tomcat/root
>rpool/zones/webphp4/ROOT/zbe 134G 3.3G 33G 10%
>/zones/webphp4/root
>
>Wed Jul 23 03:33:00 MDT 2014
>
>*************************************************
>
>Zfs List:
>NAME USED AVAIL REFER
>MOUNTPOINT
>rpool 101G 33.4G 46K /rpool
>rpool/ROOT 4.16G 33.4G 31K legacy
>rpool/ROOT/OpenIndiana-151a7-2014-0705A 10.9M 33.4G 3.87G /
>rpool/ROOT/OpenIndiana-151a7-2014-0706A 4.14G 33.4G 3.88G /
>rpool/ROOT/openindiana 12.0M 33.4G 3.48G /
>rpool/dump 8.00G 33.4G 8.00G -
>rpool/export 1.68G 33.4G 32K /export
>rpool/export/home 1.68G 33.4G 32K
>/export/home
>rpool/export/home/dsadmin 1.68G 33.4G 1.68G
>/export/home/dsadmin
>rpool/swap 8.50G 41.7G 136M -
>rpool/zones 78.2G 33.4G 37K /zones
>rpool/zones/archive 53.4G 33.4G 34K
>/zones/archive
>rpool/zones/archive/ROOT 53.4G 33.4G 32K legacy
>rpool/zones/archive/ROOT/zbe 3.14M 33.4G 27.9G legacy
>rpool/zones/archive/ROOT/zbe-1 1.98M 33.4G 28.0G legacy
>rpool/zones/archive/ROOT/zbe-2 53.4G 33.4G 28.1G legacy
>rpool/zones/mysql 1.39G 33.4G 33K
>/zones/mysql
>rpool/zones/mysql/ROOT 1.39G 33.4G 32K legacy
>rpool/zones/mysql/ROOT/zbe 1.53M 33.4G 814M legacy
>rpool/zones/mysql/ROOT/zbe-1 1.91M 33.4G 814M legacy
>rpool/zones/mysql/ROOT/zbe-2 1.39G 33.4G 940M legacy
>rpool/zones/routerb2 17.9G 33.4G 33K
>/zones/routerb2
>rpool/zones/routerb2/ROOT 17.9G 33.4G 32K legacy
>rpool/zones/routerb2/ROOT/zbe 2.98M 33.4G 8.60G legacy
>rpool/zones/routerb2/ROOT/zbe-1 9.06M 33.4G 8.63G legacy
>rpool/zones/routerb2/ROOT/zbe-2 17.9G 33.4G 8.94G legacy
>rpool/zones/tomcat 974M 33.4G 33K
>/zones/tomcat
>rpool/zones/tomcat/ROOT 974M 33.4G 32K legacy
>rpool/zones/tomcat/ROOT/zbe 1.93M 33.4G 827M legacy
>rpool/zones/tomcat/ROOT/zbe-1 2.02M 33.4G 827M legacy
>rpool/zones/tomcat/ROOT/zbe-2 970M 33.4G 827M legacy
>rpool/zones/webphp4 4.59G 33.4G 33K
>/zones/webphp4
>rpool/zones/webphp4/ROOT 4.59G 33.4G 32K legacy
>rpool/zones/webphp4/ROOT/zbe 4.59G 33.4G 3.31G legacy
>
>
>========================================================================================================
>
>Thu Jul 24 03:33:55 MDT 2014
>
>*************************************************
>*************************************************
>Disk usage:
>Filesystem size used avail capacity Mounted on
>rpool/ROOT/OpenIndiana-151a7-2014-0706A 134G 3.9G 22G 16%
>/
>/devices 0K 0K 0K 0% /devices
>/dev 0K 0K 0K 0% /dev
>ctfs 0K 0K 0K 0% /system/contract
>proc 0K 0K 0K 0% /proc
>mnttab 0K 0K 0K 0% /etc/mnttab
>swap 7.8G 384K 7.8G 1% /etc/svc/volatile
>objfs 0K 0K 0K 0% /system/object
>sharefs 0K 0K 0K 0% /etc/dfs/sharetab
>/usr/lib/libc/libc_hwcap1.so.1 26G 3.9G 22G 16%
>/lib/libc.so.1
>fd 0K 0K 0K 0% /dev/fd
>swap 7.8G 24K 7.8G 1% /tmp
>swap 7.8G 96K 7.8G 1% /var/run
>rpool/export 134G 32K 22G 1% /export
>rpool/export/home 134G 32K 22G 1% /export/home
>rpool/export/home/dsadmin 134G 1.7G 22G 8%
>/export/home/dsadmin
>rpool 134G 46K 22G 1% /rpool
>rpool/zones 134G 37K 22G 1% /zones
>rpool/zones/archive 134G 34K 22G 1% /zones/archive
>rpool/zones/mysql 134G 33K 22G 1% /zones/mysql
>rpool/zones/routerb2 134G 33K 22G 1% /zones/routerb2
>rpool/zones/tomcat 134G 33K 22G 1% /zones/tomcat
>rpool/zones/webphp4 134G 33K 22G 1% /zones/webphp4
>rpool/zones/mysql/ROOT/zbe-2 134G 940M 22G 5%
>/zones/mysql/root
>rpool/zones/tomcat/ROOT/zbe-2 134G 827M 22G 4%
>/zones/tomcat/root
>rpool/zones/archive/ROOT/zbe-2 134G 28G 22G 57%
>/zones/archive/root
>rpool/zones/routerb2/ROOT/zbe-2 134G 8.9G 22G 29%
>/zones/routerb2/root
>rpool/zones/webphp4/ROOT/zbe 134G 3.3G 22G 14%
>/zones/webphp4/root
>
>Thu Jul 24 03:33:56 MDT 2014
>
>*************************************************
>
>Zfs List:
>NAME USED AVAIL REFER
>MOUNTPOINT
>rpool 112G 22.0G 46K /rpool
>rpool/ROOT 4.16G 22.0G 31K legacy
>rpool/ROOT/OpenIndiana-151a7-2014-0705A 10.9M 22.0G 3.87G /
>rpool/ROOT/OpenIndiana-151a7-2014-0706A 4.14G 22.0G 3.89G /
>rpool/ROOT/openindiana 12.0M 22.0G 3.48G /
>rpool/dump 8.00G 22.0G 8.00G -
>rpool/export 1.68G 22.0G 32K /export
>rpool/export/home 1.68G 22.0G 32K
>/export/home
>rpool/export/home/dsadmin 1.68G 22.0G 1.68G
>/export/home/dsadmin
>rpool/swap 8.50G 30.3G 136M -
>rpool/zones 89.6G 22.0G 37K /zones
>rpool/zones/archive 61.5G 22.0G 34K
>/zones/archive
>rpool/zones/archive/ROOT 61.5G 22.0G 32K legacy
>rpool/zones/archive/ROOT/zbe 3.14M 22.0G 27.9G legacy
>rpool/zones/archive/ROOT/zbe-1 1.98M 22.0G 28.0G legacy
>rpool/zones/archive/ROOT/zbe-2 61.5G 22.0G 28.1G legacy
>rpool/zones/mysql 1.56G 22.0G 33K
>/zones/mysql
>rpool/zones/mysql/ROOT 1.56G 22.0G 32K legacy
>rpool/zones/mysql/ROOT/zbe 1.53M 22.0G 814M legacy
>rpool/zones/mysql/ROOT/zbe-1 1.91M 22.0G 814M legacy
>rpool/zones/mysql/ROOT/zbe-2 1.56G 22.0G 940M legacy
>rpool/zones/routerb2 20.4G 22.0G 33K
>/zones/routerb2
>rpool/zones/routerb2/ROOT 20.4G 22.0G 32K legacy
>rpool/zones/routerb2/ROOT/zbe 2.98M 22.0G 8.60G legacy
>rpool/zones/routerb2/ROOT/zbe-1 9.06M 22.0G 8.63G legacy
>rpool/zones/routerb2/ROOT/zbe-2 20.4G 22.0G 8.95G legacy
>rpool/zones/tomcat 1.05G 22.0G 33K
>/zones/tomcat
>rpool/zones/tomcat/ROOT 1.05G 22.0G 32K legacy
>rpool/zones/tomcat/ROOT/zbe 1.93M 22.0G 827M legacy
>rpool/zones/tomcat/ROOT/zbe-1 2.02M 22.0G 827M legacy
>rpool/zones/tomcat/ROOT/zbe-2 1.05G 22.0G 827M legacy
>rpool/zones/webphp4 5.05G 22.0G 33K
>/zones/webphp4
>rpool/zones/webphp4/ROOT 5.05G 22.0G 32K legacy
>rpool/zones/webphp4/ROOT/zbe 5.05G 22.0G 3.31G legacy
>
>========================================================================================================
>
>Fri Jul 25 03:32:42 MDT 2014
>
>*************************************************
>*************************************************
>Disk usage:
>Filesystem size used avail capacity Mounted on
>rpool/ROOT/OpenIndiana-151a7-2014-0706A 134G 3.9G 11G 27%
>/
>/devices 0K 0K 0K 0% /devices
>/dev 0K 0K 0K 0% /dev
>ctfs 0K 0K 0K 0% /system/contract
>proc 0K 0K 0K 0% /proc
>mnttab 0K 0K 0K 0% /etc/mnttab
>swap 7.9G 384K 7.9G 1% /etc/svc/volatile
>objfs 0K 0K 0K 0% /system/object
>sharefs 0K 0K 0K 0% /etc/dfs/sharetab
>/usr/lib/libc/libc_hwcap1.so.1 15G 3.9G 11G 27%
>/lib/libc.so.1
>fd 0K 0K 0K 0% /dev/fd
>swap 7.9G 24K 7.9G 1% /tmp
>swap 7.9G 96K 7.9G 1% /var/run
>rpool/export 134G 32K 11G 1% /export
>rpool/export/home 134G 32K 11G 1% /export/home
>rpool/export/home/dsadmin 134G 1.7G 11G 14%
>/export/home/dsadmin
>rpool 134G 46K 11G 1% /rpool
>rpool/zones 134G 37K 11G 1% /zones
>rpool/zones/archive 134G 34K 11G 1% /zones/archive
>rpool/zones/mysql 134G 33K 11G 1% /zones/mysql
>rpool/zones/routerb2 134G 33K 11G 1% /zones/routerb2
>rpool/zones/tomcat 134G 33K 11G 1% /zones/tomcat
>rpool/zones/webphp4 134G 33K 11G 1% /zones/webphp4
>rpool/zones/mysql/ROOT/zbe-2 134G 940M 11G 8%
>/zones/mysql/root
>rpool/zones/tomcat/ROOT/zbe-2 134G 827M 11G 7%
>/zones/tomcat/root
>rpool/zones/archive/ROOT/zbe-2 134G 28G 11G 73%
>/zones/archive/root
>rpool/zones/routerb2/ROOT/zbe-2 134G 9.0G 11G 46%
>/zones/routerb2/root
>rpool/zones/webphp4/ROOT/zbe 134G 3.3G 11G 24%
>/zones/webphp4/root
>
>Fri Jul 25 03:32:43 MDT 2014
>
>*************************************************
>
>Zfs List:
>NAME USED AVAIL REFER
>MOUNTPOINT
>rpool 123G 10.9G 46K /rpool
>rpool/ROOT 4.16G 10.9G 31K legacy
>rpool/ROOT/OpenIndiana-151a7-2014-0705A 10.9M 10.9G 3.87G /
>rpool/ROOT/OpenIndiana-151a7-2014-0706A 4.14G 10.9G 3.89G /
>rpool/ROOT/openindiana 12.0M 10.9G 3.48G /
>rpool/dump 8.00G 10.9G 8.00G -
>rpool/export 1.68G 10.9G 32K /export
>rpool/export/home 1.68G 10.9G 32K
>/export/home
>rpool/export/home/dsadmin 1.68G 10.9G 1.68G
>/export/home/dsadmin
>rpool/swap 8.50G 19.3G 136M -
>rpool/zones 101G 10.9G 37K /zones
>rpool/zones/archive 69.6G 10.9G 34K
>/zones/archive
>rpool/zones/archive/ROOT 69.6G 10.9G 32K legacy
>rpool/zones/archive/ROOT/zbe 3.14M 10.9G 27.9G legacy
>rpool/zones/archive/ROOT/zbe-1 1.98M 10.9G 28.0G legacy
>rpool/zones/archive/ROOT/zbe-2 69.6G 10.9G 28.1G legacy
>rpool/zones/mysql 1.67G 10.9G 33K
>/zones/mysql
>rpool/zones/mysql/ROOT 1.67G 10.9G 32K legacy
>rpool/zones/mysql/ROOT/zbe 1.53M 10.9G 814M legacy
>rpool/zones/mysql/ROOT/zbe-1 1.91M 10.9G 814M legacy
>rpool/zones/mysql/ROOT/zbe-2 1.67G 10.9G 940M legacy
>rpool/zones/routerb2 22.8G 10.9G 33K
>/zones/routerb2
>rpool/zones/routerb2/ROOT 22.8G 10.9G 32K legacy
>rpool/zones/routerb2/ROOT/zbe 2.98M 10.9G 8.60G legacy
>rpool/zones/routerb2/ROOT/zbe-1 9.06M 10.9G 8.63G legacy
>rpool/zones/routerb2/ROOT/zbe-2 22.8G 10.9G 8.95G legacy
>rpool/zones/tomcat 1.08G 10.9G 33K
>/zones/tomcat
>rpool/zones/tomcat/ROOT 1.08G 10.9G 32K legacy
>rpool/zones/tomcat/ROOT/zbe 1.93M 10.9G 827M legacy
>rpool/zones/tomcat/ROOT/zbe-1 2.02M 10.9G 827M legacy
>rpool/zones/tomcat/ROOT/zbe-2 1.08G 10.9G 827M legacy
>rpool/zones/webphp4 5.45G 10.9G 33K
>/zones/webphp4
>rpool/zones/webphp4/ROOT 5.45G 10.9G 32K legacy
>rpool/zones/webphp4/ROOT/zbe 5.45G 10.9G 3.31G legacy
>
>
>========================================================================================================
>
>
>_______________________________________________
>openindiana-discuss mailing list
>openindiana-discuss at openindiana.org
>http://openindiana.org/mailman/listinfo/openindiana-discuss
Hello Peter, nice to hear from you again!
after a quick look at zfs-list'ings, I see that many of your current ZBE's have more and more used space while referenced remains the same. Do you have zfs-auto-snap running? To me it seems like your zones keep lots of short-lived data (access logs that are recompressed and deleted, email queues from local daemons, etc.) and that ends up referenced only from snapshots. On the up-side, modern zfs-snap services will actively destroy older auto-snaps to free up the threshold percentage of pool size (configurable in their smf settings).
It might help to enable compression on the zone-roots if you haven't done so already, and/or split the zone filesystem into more datasets similar in ideology to my split-root setup for global zones (there are implementation differences that i haven't published yet iirc). For example, if you split off the webserver log directories, you can manage a different compression as well as a different auto-snap schedule from the rest of your system.
HTH, Jim
--
Typos courtesy of K-9 Mail on my Samsung Android
More information about the openindiana-discuss
mailing list