[OpenIndiana-discuss] Disk Space Disappearing.

Jim Klimov jimklimov at cos.ru
Wed Jul 30 10:49:18 UTC 2014


30 июля 2014 г. 9:58:34 CEST, "Dormition Skete (Hotmail)" <dormitionskete at hotmail.com> пишет:
>Could somebody please tell me where in the world all my disk space is
>disappearing to?
>
>On the 23rd, I had 33G free.  The next day, I had 22G.  The following
>day, I had 11G.
>
>If this happens again, I’m going to be out of disk space!
>
>Can somebody please tell me what in the world might be going on?  And
>how to troubleshoot it?
>
>This is primarily an email server for four people.  We simply don’t get
>11G of email in a day!  Something has to be going wrong here.
>
>Any help will be GREATLY appreciated...
>
>
>========================================================================================================
>
>Wed Jul 23 03:32:59 MDT 2014
>
>*************************************************
>*************************************************
>Disk usage:
>Filesystem             size   used  avail capacity  Mounted on
>rpool/ROOT/OpenIndiana-151a7-2014-0706A   134G   3.9G    33G    11%   
>/
>/devices                 0K     0K     0K     0%    /devices
>/dev                     0K     0K     0K     0%    /dev
>ctfs                     0K     0K     0K     0%    /system/contract
>proc                     0K     0K     0K     0%    /proc
>mnttab                   0K     0K     0K     0%    /etc/mnttab
>swap                   7.9G   396K   7.9G     1%    /etc/svc/volatile
>objfs                    0K     0K     0K     0%    /system/object
>sharefs                  0K     0K     0K     0%    /etc/dfs/sharetab
>/usr/lib/libc/libc_hwcap1.so.1    37G   3.9G    33G    11%   
>/lib/libc.so.1
>fd                       0K     0K     0K     0%    /dev/fd
>swap                   7.9G    20K   7.9G     1%    /tmp
>swap                   7.9G    92K   7.9G     1%    /var/run
>rpool/export           134G    32K    33G     1%    /export
>rpool/export/home      134G    32K    33G     1%    /export/home
>rpool/export/home/dsadmin   134G   1.7G    33G     5%   
>/export/home/dsadmin
>rpool                  134G    46K    33G     1%    /rpool
>rpool/zones            134G    37K    33G     1%    /zones
>rpool/zones/archive    134G    34K    33G     1%    /zones/archive
>rpool/zones/mysql      134G    33K    33G     1%    /zones/mysql
>rpool/zones/routerb2   134G    33K    33G     1%    /zones/routerb2
>rpool/zones/tomcat     134G    33K    33G     1%    /zones/tomcat
>rpool/zones/webphp4    134G    33K    33G     1%    /zones/webphp4
>rpool/zones/mysql/ROOT/zbe-2   134G   940M    33G     3%   
>/zones/mysql/root
>rpool/zones/archive/ROOT/zbe-2   134G    28G    33G    46%   
>/zones/archive/root
>rpool/zones/routerb2/ROOT/zbe-2   134G   8.9G    33G    22%   
>/zones/routerb2/root
>rpool/zones/tomcat/ROOT/zbe-2   134G   827M    33G     3%   
>/zones/tomcat/root
>rpool/zones/webphp4/ROOT/zbe   134G   3.3G    33G    10%   
>/zones/webphp4/root
>
>Wed Jul 23 03:33:00 MDT 2014
>
>*************************************************
>
>Zfs List:
>NAME                                      USED  AVAIL  REFER 
>MOUNTPOINT
>rpool                                     101G  33.4G    46K  /rpool
>rpool/ROOT                               4.16G  33.4G    31K  legacy
>rpool/ROOT/OpenIndiana-151a7-2014-0705A  10.9M  33.4G  3.87G  /
>rpool/ROOT/OpenIndiana-151a7-2014-0706A  4.14G  33.4G  3.88G  /
>rpool/ROOT/openindiana                   12.0M  33.4G  3.48G  /
>rpool/dump                               8.00G  33.4G  8.00G  -
>rpool/export                             1.68G  33.4G    32K  /export
>rpool/export/home                        1.68G  33.4G    32K 
>/export/home
>rpool/export/home/dsadmin                1.68G  33.4G  1.68G 
>/export/home/dsadmin
>rpool/swap                               8.50G  41.7G   136M  -
>rpool/zones                              78.2G  33.4G    37K  /zones
>rpool/zones/archive                      53.4G  33.4G    34K 
>/zones/archive
>rpool/zones/archive/ROOT                 53.4G  33.4G    32K  legacy
>rpool/zones/archive/ROOT/zbe             3.14M  33.4G  27.9G  legacy
>rpool/zones/archive/ROOT/zbe-1           1.98M  33.4G  28.0G  legacy
>rpool/zones/archive/ROOT/zbe-2           53.4G  33.4G  28.1G  legacy
>rpool/zones/mysql                        1.39G  33.4G    33K 
>/zones/mysql
>rpool/zones/mysql/ROOT                   1.39G  33.4G    32K  legacy
>rpool/zones/mysql/ROOT/zbe               1.53M  33.4G   814M  legacy
>rpool/zones/mysql/ROOT/zbe-1             1.91M  33.4G   814M  legacy
>rpool/zones/mysql/ROOT/zbe-2             1.39G  33.4G   940M  legacy
>rpool/zones/routerb2                     17.9G  33.4G    33K 
>/zones/routerb2
>rpool/zones/routerb2/ROOT                17.9G  33.4G    32K  legacy
>rpool/zones/routerb2/ROOT/zbe            2.98M  33.4G  8.60G  legacy
>rpool/zones/routerb2/ROOT/zbe-1          9.06M  33.4G  8.63G  legacy
>rpool/zones/routerb2/ROOT/zbe-2          17.9G  33.4G  8.94G  legacy
>rpool/zones/tomcat                        974M  33.4G    33K 
>/zones/tomcat
>rpool/zones/tomcat/ROOT                   974M  33.4G    32K  legacy
>rpool/zones/tomcat/ROOT/zbe              1.93M  33.4G   827M  legacy
>rpool/zones/tomcat/ROOT/zbe-1            2.02M  33.4G   827M  legacy
>rpool/zones/tomcat/ROOT/zbe-2             970M  33.4G   827M  legacy
>rpool/zones/webphp4                      4.59G  33.4G    33K 
>/zones/webphp4
>rpool/zones/webphp4/ROOT                 4.59G  33.4G    32K  legacy
>rpool/zones/webphp4/ROOT/zbe             4.59G  33.4G  3.31G  legacy
>
>
>========================================================================================================
>
>Thu Jul 24 03:33:55 MDT 2014
>
>*************************************************
>*************************************************
>Disk usage:
>Filesystem             size   used  avail capacity  Mounted on
>rpool/ROOT/OpenIndiana-151a7-2014-0706A   134G   3.9G    22G    16%   
>/
>/devices                 0K     0K     0K     0%    /devices
>/dev                     0K     0K     0K     0%    /dev
>ctfs                     0K     0K     0K     0%    /system/contract
>proc                     0K     0K     0K     0%    /proc
>mnttab                   0K     0K     0K     0%    /etc/mnttab
>swap                   7.8G   384K   7.8G     1%    /etc/svc/volatile
>objfs                    0K     0K     0K     0%    /system/object
>sharefs                  0K     0K     0K     0%    /etc/dfs/sharetab
>/usr/lib/libc/libc_hwcap1.so.1    26G   3.9G    22G    16%   
>/lib/libc.so.1
>fd                       0K     0K     0K     0%    /dev/fd
>swap                   7.8G    24K   7.8G     1%    /tmp
>swap                   7.8G    96K   7.8G     1%    /var/run
>rpool/export           134G    32K    22G     1%    /export
>rpool/export/home      134G    32K    22G     1%    /export/home
>rpool/export/home/dsadmin   134G   1.7G    22G     8%   
>/export/home/dsadmin
>rpool                  134G    46K    22G     1%    /rpool
>rpool/zones            134G    37K    22G     1%    /zones
>rpool/zones/archive    134G    34K    22G     1%    /zones/archive
>rpool/zones/mysql      134G    33K    22G     1%    /zones/mysql
>rpool/zones/routerb2   134G    33K    22G     1%    /zones/routerb2
>rpool/zones/tomcat     134G    33K    22G     1%    /zones/tomcat
>rpool/zones/webphp4    134G    33K    22G     1%    /zones/webphp4
>rpool/zones/mysql/ROOT/zbe-2   134G   940M    22G     5%   
>/zones/mysql/root
>rpool/zones/tomcat/ROOT/zbe-2   134G   827M    22G     4%   
>/zones/tomcat/root
>rpool/zones/archive/ROOT/zbe-2   134G    28G    22G    57%   
>/zones/archive/root
>rpool/zones/routerb2/ROOT/zbe-2   134G   8.9G    22G    29%   
>/zones/routerb2/root
>rpool/zones/webphp4/ROOT/zbe   134G   3.3G    22G    14%   
>/zones/webphp4/root
>
>Thu Jul 24 03:33:56 MDT 2014
>
>*************************************************
>
>Zfs List:
>NAME                                      USED  AVAIL  REFER 
>MOUNTPOINT
>rpool                                     112G  22.0G    46K  /rpool
>rpool/ROOT                               4.16G  22.0G    31K  legacy
>rpool/ROOT/OpenIndiana-151a7-2014-0705A  10.9M  22.0G  3.87G  /
>rpool/ROOT/OpenIndiana-151a7-2014-0706A  4.14G  22.0G  3.89G  /
>rpool/ROOT/openindiana                   12.0M  22.0G  3.48G  /
>rpool/dump                               8.00G  22.0G  8.00G  -
>rpool/export                             1.68G  22.0G    32K  /export
>rpool/export/home                        1.68G  22.0G    32K 
>/export/home
>rpool/export/home/dsadmin                1.68G  22.0G  1.68G 
>/export/home/dsadmin
>rpool/swap                               8.50G  30.3G   136M  -
>rpool/zones                              89.6G  22.0G    37K  /zones
>rpool/zones/archive                      61.5G  22.0G    34K 
>/zones/archive
>rpool/zones/archive/ROOT                 61.5G  22.0G    32K  legacy
>rpool/zones/archive/ROOT/zbe             3.14M  22.0G  27.9G  legacy
>rpool/zones/archive/ROOT/zbe-1           1.98M  22.0G  28.0G  legacy
>rpool/zones/archive/ROOT/zbe-2           61.5G  22.0G  28.1G  legacy
>rpool/zones/mysql                        1.56G  22.0G    33K 
>/zones/mysql
>rpool/zones/mysql/ROOT                   1.56G  22.0G    32K  legacy
>rpool/zones/mysql/ROOT/zbe               1.53M  22.0G   814M  legacy
>rpool/zones/mysql/ROOT/zbe-1             1.91M  22.0G   814M  legacy
>rpool/zones/mysql/ROOT/zbe-2             1.56G  22.0G   940M  legacy
>rpool/zones/routerb2                     20.4G  22.0G    33K 
>/zones/routerb2
>rpool/zones/routerb2/ROOT                20.4G  22.0G    32K  legacy
>rpool/zones/routerb2/ROOT/zbe            2.98M  22.0G  8.60G  legacy
>rpool/zones/routerb2/ROOT/zbe-1          9.06M  22.0G  8.63G  legacy
>rpool/zones/routerb2/ROOT/zbe-2          20.4G  22.0G  8.95G  legacy
>rpool/zones/tomcat                       1.05G  22.0G    33K 
>/zones/tomcat
>rpool/zones/tomcat/ROOT                  1.05G  22.0G    32K  legacy
>rpool/zones/tomcat/ROOT/zbe              1.93M  22.0G   827M  legacy
>rpool/zones/tomcat/ROOT/zbe-1            2.02M  22.0G   827M  legacy
>rpool/zones/tomcat/ROOT/zbe-2            1.05G  22.0G   827M  legacy
>rpool/zones/webphp4                      5.05G  22.0G    33K 
>/zones/webphp4
>rpool/zones/webphp4/ROOT                 5.05G  22.0G    32K  legacy
>rpool/zones/webphp4/ROOT/zbe             5.05G  22.0G  3.31G  legacy
>
>========================================================================================================
>
>Fri Jul 25 03:32:42 MDT 2014
>
>*************************************************
>*************************************************
>Disk usage:
>Filesystem             size   used  avail capacity  Mounted on
>rpool/ROOT/OpenIndiana-151a7-2014-0706A   134G   3.9G    11G    27%   
>/
>/devices                 0K     0K     0K     0%    /devices
>/dev                     0K     0K     0K     0%    /dev
>ctfs                     0K     0K     0K     0%    /system/contract
>proc                     0K     0K     0K     0%    /proc
>mnttab                   0K     0K     0K     0%    /etc/mnttab
>swap                   7.9G   384K   7.9G     1%    /etc/svc/volatile
>objfs                    0K     0K     0K     0%    /system/object
>sharefs                  0K     0K     0K     0%    /etc/dfs/sharetab
>/usr/lib/libc/libc_hwcap1.so.1    15G   3.9G    11G    27%   
>/lib/libc.so.1
>fd                       0K     0K     0K     0%    /dev/fd
>swap                   7.9G    24K   7.9G     1%    /tmp
>swap                   7.9G    96K   7.9G     1%    /var/run
>rpool/export           134G    32K    11G     1%    /export
>rpool/export/home      134G    32K    11G     1%    /export/home
>rpool/export/home/dsadmin   134G   1.7G    11G    14%   
>/export/home/dsadmin
>rpool                  134G    46K    11G     1%    /rpool
>rpool/zones            134G    37K    11G     1%    /zones
>rpool/zones/archive    134G    34K    11G     1%    /zones/archive
>rpool/zones/mysql      134G    33K    11G     1%    /zones/mysql
>rpool/zones/routerb2   134G    33K    11G     1%    /zones/routerb2
>rpool/zones/tomcat     134G    33K    11G     1%    /zones/tomcat
>rpool/zones/webphp4    134G    33K    11G     1%    /zones/webphp4
>rpool/zones/mysql/ROOT/zbe-2   134G   940M    11G     8%   
>/zones/mysql/root
>rpool/zones/tomcat/ROOT/zbe-2   134G   827M    11G     7%   
>/zones/tomcat/root
>rpool/zones/archive/ROOT/zbe-2   134G    28G    11G    73%   
>/zones/archive/root
>rpool/zones/routerb2/ROOT/zbe-2   134G   9.0G    11G    46%   
>/zones/routerb2/root
>rpool/zones/webphp4/ROOT/zbe   134G   3.3G    11G    24%   
>/zones/webphp4/root
>
>Fri Jul 25 03:32:43 MDT 2014
>
>*************************************************
>
>Zfs List:
>NAME                                      USED  AVAIL  REFER 
>MOUNTPOINT
>rpool                                     123G  10.9G    46K  /rpool
>rpool/ROOT                               4.16G  10.9G    31K  legacy
>rpool/ROOT/OpenIndiana-151a7-2014-0705A  10.9M  10.9G  3.87G  /
>rpool/ROOT/OpenIndiana-151a7-2014-0706A  4.14G  10.9G  3.89G  /
>rpool/ROOT/openindiana                   12.0M  10.9G  3.48G  /
>rpool/dump                               8.00G  10.9G  8.00G  -
>rpool/export                             1.68G  10.9G    32K  /export
>rpool/export/home                        1.68G  10.9G    32K 
>/export/home
>rpool/export/home/dsadmin                1.68G  10.9G  1.68G 
>/export/home/dsadmin
>rpool/swap                               8.50G  19.3G   136M  -
>rpool/zones                               101G  10.9G    37K  /zones
>rpool/zones/archive                      69.6G  10.9G    34K 
>/zones/archive
>rpool/zones/archive/ROOT                 69.6G  10.9G    32K  legacy
>rpool/zones/archive/ROOT/zbe             3.14M  10.9G  27.9G  legacy
>rpool/zones/archive/ROOT/zbe-1           1.98M  10.9G  28.0G  legacy
>rpool/zones/archive/ROOT/zbe-2           69.6G  10.9G  28.1G  legacy
>rpool/zones/mysql                        1.67G  10.9G    33K 
>/zones/mysql
>rpool/zones/mysql/ROOT                   1.67G  10.9G    32K  legacy
>rpool/zones/mysql/ROOT/zbe               1.53M  10.9G   814M  legacy
>rpool/zones/mysql/ROOT/zbe-1             1.91M  10.9G   814M  legacy
>rpool/zones/mysql/ROOT/zbe-2             1.67G  10.9G   940M  legacy
>rpool/zones/routerb2                     22.8G  10.9G    33K 
>/zones/routerb2
>rpool/zones/routerb2/ROOT                22.8G  10.9G    32K  legacy
>rpool/zones/routerb2/ROOT/zbe            2.98M  10.9G  8.60G  legacy
>rpool/zones/routerb2/ROOT/zbe-1          9.06M  10.9G  8.63G  legacy
>rpool/zones/routerb2/ROOT/zbe-2          22.8G  10.9G  8.95G  legacy
>rpool/zones/tomcat                       1.08G  10.9G    33K 
>/zones/tomcat
>rpool/zones/tomcat/ROOT                  1.08G  10.9G    32K  legacy
>rpool/zones/tomcat/ROOT/zbe              1.93M  10.9G   827M  legacy
>rpool/zones/tomcat/ROOT/zbe-1            2.02M  10.9G   827M  legacy
>rpool/zones/tomcat/ROOT/zbe-2            1.08G  10.9G   827M  legacy
>rpool/zones/webphp4                      5.45G  10.9G    33K 
>/zones/webphp4
>rpool/zones/webphp4/ROOT                 5.45G  10.9G    32K  legacy
>rpool/zones/webphp4/ROOT/zbe             5.45G  10.9G  3.31G  legacy
>
>
>========================================================================================================
>
>
>_______________________________________________
>openindiana-discuss mailing list
>openindiana-discuss at openindiana.org
>http://openindiana.org/mailman/listinfo/openindiana-discuss

Hello Peter, nice to hear from you again!

after a quick look at zfs-list'ings, I see that many of your current ZBE's have more and more used space while referenced remains the same. Do you have zfs-auto-snap running? To me it seems like your zones keep lots of short-lived data (access logs that are recompressed and deleted, email queues from local daemons, etc.) and that ends up referenced only from snapshots. On the up-side, modern zfs-snap services will actively destroy older auto-snaps to free up the threshold percentage of pool size (configurable in their smf settings).

It might help to enable compression on the zone-roots if you haven't done so already, and/or split the zone filesystem into more datasets similar in ideology to my split-root setup for global zones (there are implementation differences that i haven't published yet iirc). For example, if you split off the webserver log directories, you can manage a different compression as well as a different auto-snap schedule from the rest of your system.

HTH, Jim
--
Typos courtesy of K-9 Mail on my Samsung Android



More information about the openindiana-discuss mailing list