Subject: kern/29445: panic: uvm_mapent_alloc: out of static map entries, check MAX_KMAPENT (currently 1114)
To: None <kern-bug-people@netbsd.org, gnats-admin@netbsd.org,>
From: None <keriax@gmail.com>
List: netbsd-bugs
Date: 02/19/2005 03:30:00
>Number:         29445
>Category:       kern
>Synopsis:       panic: uvm_mapent_alloc: out of static map entries, check MAX_KMAPENT (currently 1114)
>Confidential:   no
>Severity:       serious
>Priority:       high
>Responsible:    kern-bug-people
>State:          open
>Class:          sw-bug
>Submitter-Id:   net
>Arrival-Date:   Sat Feb 19 03:30:00 +0000 2005
>Originator:     Alexey Dvoychenkov
>Release:        NetBSD 2.0 (GENERIC)
>Organization:
N/A
>Environment:
NetBSD alpha.lip.local 2.0 NetBSD 2.0 (GENERIC) #0: Wed Dec  1 10:58:25 UTC 2004  builds@build:/big/builds/ab/netbsd-2-0-RELEASE/i386/200411300000Z-obj/big/builds/ab/netbsd-2-0-RELEASE/src/sys/arch/i386/compile/GENERIC i386

>Description:
I'm experiencing daily kernel panics with above message. The panics are consistent, with approximately 30 hour interval.

The system is used as a gateway/firewall/proxy and the load pretty low.

I've tried to provide exhaustive information, but please tell me if something necessary is missing.

Here is dmesg parts which could be relevant:

total memory = 238 MB
avail memory = 226 MB
BIOS32 rev. 0 found at 0xf0010
mainbus0 (root)
cpu0 at mainbus0: (uniprocessor)
cpu0: Intel Celeron (686-class), 1995.08 MHz, id 0xf29
cpu0: features bfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR>
cpu0: features bfebfbff<PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX>
cpu0: features bfebfbff<FXSR,SSE,SSE2,SS,HTT,TM,SBF>
cpu0: I-cache 12K uOp cache 8-way, D-cache 8 KB 64B/line 4-way
cpu0: ITLB 4K/4M: 128 entries
cpu0: DTLB 4K/4M: 64 entries

GDB output:

(gdb) file netbsd.1
Reading symbols from netbsd.1...(no debugging symbols found)...done.
(gdb) target kcore netbsd.1.core
panic: uvm_mapent_alloc: out of static map entries, check MAX_KMAPENT (currently %d)
#0  0x0ee30000 in ?? ()
(gdb) where
#0  0x0ee30000 in ?? ()
#1  0xc040634f in cpu_reboot ()
#2  0xc033cedc in db_sync_cmd ()
#3  0xc033c92b in db_command ()
#4  0xc033c63e in db_command_loop ()
#5  0xc033f708 in db_trap ()
#6  0xc0403b1a in kdb_trap ()
#7  0xc041085f in trap ()
#8  0xc0102ed3 in calltrap ()
#9  0xc037c4ed in panic ()
#10 0xc03f6d48 in uvm_mapent_alloc ()
#11 0xc03f2ccc in uvm_map_clip_end ()
#12 0xc03f4407 in uvm_unmap_remove ()
#13 0xc03f1ec1 in uvm_unmap ()
#14 0xc03f1059 in uvm_km_free_poolpage1 ()
#15 0xc037c132 in pool_allocator_free ()
#16 0xc037b621 in pool_reclaim ()
#17 0xc037b735 in pool_drain ()
#18 0xc03facd2 in uvm_pageout ()

alpha# ps aux -N netbsd.1 -M netbsd.1.core
USER     PID %CPU %MEM   VSZ RSS TT STAT STARTED    TIME COMMAND
root       0  0.0  0.0     0   0 ?? RWKs Fri10AM 0:00.00 [swapper]
root       1  0.0  0.0    60   0 ?? RWs  Fri10AM 0:00.00 init
root       2  0.0  0.0     0   0 ?? RWK  Fri10AM 0:00.00 [cryptoret]
root       3  0.0  0.0     0   0 ?? RWK  Fri10AM 0:00.00 [usb0]
root       4  0.0  0.0     0   0 ?? RWK  Fri10AM 0:00.00 [usbtask]
root       5  0.0  0.0     0   0 ?? RWK  Fri10AM 0:00.00 [usb1]
root       6  0.0  0.0     0   0 ?? RWK  Fri10AM 0:00.00 [usb2]
root       7  0.0  0.0     0   0 ?? RWK  Fri10AM 0:00.00 [atabus0]
root       8  0.0  0.0     0   0 ?? RWK  Fri10AM 0:00.00 [atabus1]
root       9  0.0  0.0     0   0 ?? RWK  Fri10AM 0:00.00 [atapibus0]
root      10  0.0  0.0     0   0 ?? RWK  Fri10AM 0:00.00 [lfs_writer]
root      11  0.0  0.0     0   0 ?? RWK  Fri10AM 0:01.00 [pagedaemon]
root      12  0.0  0.0     0   0 ?? RWK  Fri10AM 0:00.00 [ioflush]
root      13  0.0  0.0     0   0 ?? RWK  Fri10AM 0:00.00 [aiodoned]
root     108  0.0  0.0  1648   0 ?? RWs  Fri10AM 0:00.00 (squid)
nobody   142  0.0  0.0  7068   0 ?? RW   Fri10AM 0:00.00 /usr/httpd/bin/httpd
nobody   160  0.0  0.0  7020   0 ?? RW   Fri10AM 0:00.00 /usr/httpd/bin/httpd
nobody   162  0.0  0.0  7040   0 ?? RW   Fri10AM 0:00.00 /usr/httpd/bin/httpd
nobody   163  0.0  0.0  6960   0 ?? RW   Fri10AM 0:00.00 /usr/httpd/bin/httpd
nobody   164  0.0  0.0  7272   0 ?? RW   Fri10AM 0:00.00 (httpd)
nobody   174  0.0  0.0 61992   0 ?? RW   Fri10AM 0:00.00 (unlinkd) (squid)
nobody   232  0.0  0.0  7528   0 ?? RW   Fri10AM 0:00.00 (httpd)
root     281  0.0  0.0  4632   0 ?? RWsa Fri10AM 0:00.00 /usr/named/sbin/named
root     282  0.0  0.0   192   0 ?? RWs  Fri10AM 0:00.00 /usr/sbin/syslogd -s
nobody   331  0.0  0.0  8048   0 ?? RW   Fri10AM 0:00.00 (httpd)
root     347  0.0  0.0   200   0 ?? RWs  Fri10AM 0:00.00 mount_mfs -s 8389584 /dev/wd0b /tmp
nobody   357  0.0  0.0  7748   0 ?? RW   Fri10AM 0:00.00 (httpd)
root     440  0.0  0.0   340   0 ?? RWs  Fri10AM 0:01.00 /usr/sbin/sshd
root     447  0.0  0.0  1072   0 ?? RWs  Fri10AM 0:00.00 /usr/sbin/dhcpd rtk0
root     472  0.0  0.0  1400   0 ?? RW   Fri10AM 0:01.00 (winbindd)
nobody   506  0.0  0.0  7516   0 ?? RW   Fri10AM 0:00.00 (httpd)
root     593  0.0  0.0  1040   0 ?? RWs  Fri10AM 0:00.00 sendmail: accepting connections
_pflogd  598  0.0  0.0  1244   0 ?? RW   Fri10AM 0:00.00 (pflogd)
root     604  0.0  0.0  1192   0 ?? RWs  Fri10AM 0:25.00 pflogd: [priv]
root     621  0.0  0.0  2660   0 ?? RW   Fri11AM 0:00.00 (smbd)
root     628  0.0  0.0    60   0 ?? RWs  Fri10AM 0:25.00 (inetd)
root     637  0.0  0.0   224   0 ?? RWs  Fri10AM 0:00.00 (cron)
root     659  0.0  0.0   412   0 ?? RWs  Fri10AM 0:00.00 (sshd)
root     660  0.0  0.0  2324   0 ?? RWs  Fri10AM 0:00.00 /usr/sbin/cron (smbd)
root     663  0.0  0.0  1944   0 ?? RWs  Fri10AM 0:00.00 /usr/samba/sbin/winbindd
root     694  0.0  0.0  2324   0 ?? RW   Fri10AM 0:00.00 (smbd)
root     754  0.0  0.0   928   0 ?? RWs  Fri10AM 0:00.00 (nmbd)
root     783  0.0  0.0  5704   0 ?? RWs  Fri10AM 0:00.00 /usr/httpd/bin/httpd
nobody   815  0.0  0.0    12   0 ?? RWs  Fri10AM 0:00.00 (unlinkd)
nobody   979  0.0  0.0  7828   0 ?? RW   Fri11AM 0:00.00 (httpd)
root      97  0.0  0.0   112   0 p0 RW   Fri10AM 0:00.00 vsftpd
root     105  0.0  0.0  1196   0 p0 RW   Fri10AM 0:00.00 ./zorra
postgres 171  0.0  0.0  2600   0 p0 RW   Fri10AM 0:00.00 (postgres)
root     658  0.0  0.0   208   0 p0 RWs+ Fri10AM 0:00.00 -csh
postgres 661  0.0  0.0  3604   0 p0 RW   Fri10AM 0:00.00 (postgres)
postgres 816  0.0  0.0  2656   0 p0 RW   Fri10AM 0:04.00 postmaster: writer process    (postgres)
postgres 819  0.0  0.0  2628   0 p0 RW   Fri10AM 0:00.00 (postgres)
root     631  0.0  0.0    48   0 E0 RWs+ Fri10AM 0:17.00 /usr/libexec/getty Pc console
root     565  0.0  0.0    48   0 E1 RWs+ Fri10AM 0:17.00 /usr/libexec/getty Pc ttyE1
root     638  0.0  0.0    48   0 E2 RWs+ Fri10AM 0:17.00 /usr/libexec/getty Pc ttyE2
root     656  0.0  0.0    48   0 E3 RWs+ Fri10AM 0:17.00 /usr/libexec/getty Pc ttyE3

alpha# ps aux -N netbsd.1 -M netbsd.1.core | grep -v '%MEM' | awk '{ print "-" $5 }' | xargs | bc
-178828

alpha# vmstat -N netbsd.1 -M netbsd.1.core -m
vmstat: Kmem statistics are not being gathered by the kernel.
Memory resource pool statistics
Name        Size Requests Fail Releases Pgreq Pgrel Npage Hiwat Minpg Maxpg Idle
phpool        40     2856    0     1128    18     0    18    18     0   inf    0
pcgpool      140     1904    0      881    64    27    37    37     0   inf    0
pmappl        76     2230    0     2187     7     3     4     4     0   inf    3
pdppl       4096      340    0      284   318   135   183   185     0   inf  127
vmsppl       220     2230    0     2187    19     8    11    11     0   inf    8
vmmpepl       88   186020    0   184658   288   127   161   161     0   inf  126
vmmpekpl      88    11644    0    11528     4     0     4     4     0   inf    1
uaoeltpl      84       27    0        1     1     0     1     1     0   inf    0
aobjpl        52        2    0        0     1     0     1     1     0   inf    0
amappl        40    21980    0    21514    30    12    18    18     0   inf   12
bufpl        120   153786    0   144384   366    67   299   299     0   inf    3
buf1k       1024    27228    0    19234   336   208   128   129     1     1    0
buf2k       2048      451    0      374     7     3     4     4     1     1    0
buf4k       4096      282    0      224    10     6     4     5     1     1    0
buf8k       8192     4032    0     2776   224    58   166   168     1     1    0
buf16k      16384      30    0       27     6     4     2     3     1     1    0
mbpl         256    28574    0    12281  1665   645  1020  1020     1   inf    1
mclpl       2048      722    0      528   216    28   188   192     4   512   79
kqueuepl     260        1    0        0     1     0     1     1     0   inf    0
knotepl       72        5    0        0     1     0     1     1     0   inf    0
sockpl       200   200513    0   200419  1389   587   802   802     0   inf  785
ttypl        264       71    0        0     5     0     5     5     0   inf    0
rndsample    528     3044    0     3039     1     0     1     1     0   inf    0
procpl       408     2255    0     2200    33    13    20    20     0   inf   14
lwppl        132     2259    0     2200    10     3     7     7     0   inf    4
pgrppl        16      334    0      309     1     0     1     1     0   inf    0
pcredpl       24     2255    0     2200     3     1     2     2     0   inf    1
plimitpl     156       37    0       27     1     0     1     1     0   inf    0
pstatspl     224     2255    0     2200    17     6    11    11     0   inf    7
rusgepl       72     2200    0     2200     4     3     1     1     0   inf    1
raspl         20        2    0        1     1     0     1     1     0   inf    0
sadatapl      40        1    0        0     1     0     1     1     0   inf    0
saupcpl     1608    44623    0    44623     2     1     1     1     0   inf    1
sastackpl     24       16    0        0     1     0     1     1     0   inf    0
savppl        52        1    0        0     1     0     1     1     0   inf    0
ptimerpl     124       21    0       14     1     0     1     1     0   inf    0
filepl        56   458121    0   457909    10     2     8     8     0   inf    2
cwdipl        12     2243    0     2200     1     0     1     1     0   inf    0
fdescpl      280     2243    0     2200    23     9    14    14     0   inf   10
pnbufpl     1024       21    0       17     2     1     1     2     0   inf    0
vnodepl      164    17026    0     1758   637     0   637   637     0   inf    0
ncachepl      84   204828    0   190408   319     0   319   319     0   inf    0
ffsinopl     176   202831    0   187582   664     0   664   664     0   inf    0
dino1pl      128   202831    0   187582   493     0   493   493     0   inf    0
cd9660nopl   152      196    0      186     4     0     4     4     0   inf    1
extent        20     2257    0     2174     1     0     1     1     0   inf    0
wdcspl        52   196492    0   196491     1     0     1     1     0   inf    0
shmmp         12        2    0        1     1     0     1     1     0   inf    0
rtentpl      132       78    0       36     2     0     2     2     0   inf    0
inpcbpl      108   199943    0   199872   747   735    12   433     0   inf    0
in6pcbpl     156       28    0       22     1     0     1     1     0   inf    0
inmltpl       32        3    0        0     1     0     1     1     0   inf    0
tcpcbpl      316   150449    0   150389  2311  2295    16  1321     0   inf    1
tcpipqepl     44    89752    0    89751     2     1     1     1     0   inf    0
synpl        184    81681    0    81679     3     2     1     1     0   inf    0
sigapl      2052     2243    0     2200   330   147   183   185     0   inf  140
siginfo      128     4396    0     4396     4     3     1     1     0   inf    1
ksiginfo      44        1    0        0     1     0     1     1     0   inf    0
scxspl       148      508    0      508     1     0     1     1     1   inf    1
pipepl       140     1542    0     1522     3     1     2     2     0   inf    1
pfrulepl     556       25    0        0     4     0     4     4     0   inf    0
pfstatepl    256    23733    0    23706    37    27    10    21     0   625    3
pfpooladdrpl  68        1    0        0     1     0     1     1     0   inf    0
pfrktable   1240        8    0        7     1     0     1     1     0   inf    0
pfrkentry    152        9    0        0     1     0     1     1     0   inf    0
pfosfpen     108      345    0        0    10     0    10    10     0   inf    0
pfosfp        28      188    0        0     2     0     2     2     0   inf    0

In use 33088K, total allocated 40252K; utilization 82.2%

Now, I'll try to rebuild kernel with higher MAX_KMAPENT value, as panic message suggested...
>How-To-Repeat:

>Fix: