[OpenIndiana-discuss] oi_151a3 svc.startd chewing up memory

[Jim Klimov]

Hello all,

On a test box running OI oi_151a3 I found that it can not restart
services due to svc.startd being 2500M in VM size. As a consequence,
fork() fails due to insufficient free VM (swap space) and services
can not start.

I guess there is a leak somewhere, was anything like that fixed in
the past month or so?

DETAILS

 From dmesg:

May 29 03:25:51 blade5 svc.startd[10]: [ID 462725 daemon.warning] 
svc:/network/nfs/status:default: Couldn't fork to execute method 
/usr/lib/nfs/statd: Not enough space

May 29 03:25:51 blade5 svc.startd[10]: [ID 748625 daemon.error] 
network/nfs/status:default failed: transitioned to maintenance (see 
'svcs -xv' for details)


 From top:

last pid: 28885;  load avg:  0.06,  0.07,  0.06;  up 37+05:06:27 
03:27:45
70 processes: 69 sleeping, 1 on cpu
CPU states: 99.5% idle,  0.0% user,  0.5% kernel,  0.0% iowait,  0.0% swap
Kernel: 340 ctxsw, 607 intr, 110 syscall
Memory: 4090M phys mem, 863M free mem, 2045M total swap, 1775M free swap
    PID USERNAME NLWP PRI NICE  SIZE   RES STATE    TIME    CPU COMMAND
     10 root       15  59    0 2500M 2238M sleep  681:20  0.00% svc.startd
...

The box is up for a month, during this time the process ate
about 11 hours of CPU time. And lots of RAM and some disk
swap too (all of the consumed).

# svcs -p restarter
STATE          STIME    FMRI
online         May_03   svc:/system/svc/restarter:default
                May_03         10 svc.startd

svcadm-restarting the service did not help, however a kill
went seemingly well, freeing up lots of RAM and disk swap,
and restarting a few services:

# svcs
...
online          3:27:57 svc:/system/svc/restarter:default
online          3:27:58 svc:/application/cups/in-lpd:default
online          3:27:58 svc:/network/rpc/smserver:default
online          3:27:58 svc:/network/physical:default
online          3:28:00 svc:/network/smb/server:default

# top
last pid: 28941;  load avg:  0.07,  0.07,  0.06;  up 37+05:06:42 
03:28:00
70 processes: 69 sleeping, 1 on cpu
CPU states: 99.1% idle,  0.0% user,  0.9% kernel,  0.0% iowait,  0.0% swap
Kernel: 1281 ctxsw, 863 intr, 697 syscall
Memory: 4090M phys mem, 3080M free mem, 2045M total swap, 2036M free swap

Thanks,
//Jim Klimov