port-amd64/46233: NetBSD 6.0 Beta on VMware crashes

[joernc%gmail.com@localhost]

>Number:         46233
>Category:       port-amd64
>Synopsis:       NetBSD 6.0 Beta on VMware crashes
>Confidential:   no
>Severity:       serious
>Priority:       medium
>Responsible:    port-amd64-maintainer
>State:          open
>Class:          sw-bug
>Submitter-Id:   net
>Arrival-Date:   Wed Mar 21 07:55:00 +0000 2012
>Originator:     Jörn Clausen
>Release:        NetBSD 6.0_BETA
>Organization:
>Environment:
NetBSD hexan 6.0_BETA NetBSD 6.0_BETA (GENERIC) amd64

>Description:
I gave 6.0 Beta a spin in a virtual machine hosted on ESX 4.1. I used VMware 
default configuration (1 virtual CPU, 256 MB RAM). I installed the system on a 
12 GB thin provisioned disk and added a second disk of 80 GB thin provisioned 
at /usr/pkgsrc. I compiled pgksrc, and after several hours, the system crashed. 
This first dmesg output was gathered via crash(8), the corresponding dumps are 
still available:

NetBSD 6.0_BETA (GENERIC)
total memory = 255 MB
avail memory = 232 MB
timecounter: Timecounters tick every 10.000 msec
timecounter: Timecounter "i8254" frequency 1193182 Hz quality 100
VMware, Inc. VMware Virtual Platform (None)
mainbus0 (root)
cpu0 at mainbus0 apid 0: Quad-Core AMD Opteron(tm) Processor 2380, id 0x100f42
ioapic0 at mainbus0 apid 1: pa 0xfec00000, version 11, 24 pins
acpi0 at mainbus0: Intel ACPICA 20110623
acpi0: X/RSDT: OemId <INTEL ,440BX   ,06040000>, AslId <VMW ,01324272>
acpi0: SCI interrupting at int 9
timecounter: Timecounter "ACPI-Safe" frequency 3579545 Hz quality 900
MBRD (PNP0C02) at acpi0 not configured
PIC (PNP0001) at acpi0 not configured
attimer1 at acpi0 (TIME, PNP0100): io 0x40-0x43 irq 0
pcppi1 at acpi0 (SPKR, PNP0800): io 0x61
midi0 at pcppi1: PC speaker
sysbeep0 at pcppi1
pckbc1 at acpi0 (KBC, PNP0303) (kbd port): io 0x60,0x64 irq 1
pckbc2 at acpi0 (MOUS, PNP0F13) (aux port): irq 12
LPTB (PNP0400) at acpi0 not configured
COMA (PNP0501) at acpi0 not configured
COMB (PNP0501) at acpi0 not configured
FDC (PNP0700) at acpi0 not configured
EXPL (PNP0C02) at acpi0 not configured
acpiacad0 at acpi0 (ACAD, ACPI0003-1): ACPI AC Adapter
attimer1: attached to pcppi1
pckbd0 at pckbc1 (kbd slot)
pckbc1: using irq 1 for kbd slot
wskbd0 at pckbd0: console keyboard
pms0 at pckbc1 (aux slot)
pckbc1: using irq 12 for aux slot
wsmouse0 at pms0 mux 0
pci0 at mainbus0 bus 0: configuration mode 1
pci0: i/o space, memory space enabled, rd/line, rd/mult, wr/inv ok
pchb0 at pci0 dev 0 function 0: vendor 0x8086 product 0x7190 (rev. 0x01)
ppb0 at pci0 dev 1 function 0: vendor 0x8086 product 0x7191 (rev. 0x01)
pci1 at ppb0 bus 1
pci1: i/o space, memory space enabled
pcib0 at pci0 dev 7 function 0: vendor 0x8086 product 0x7110 (rev. 0x08)
piixide0 at pci0 dev 7 function 1: Intel 82371AB IDE controller (PIIX4) (rev. 
0x01)
piixide0: bus-master DMA support present
piixide0: primary channel configured to compatibility mode
piixide0: primary channel interrupting at ioapic0 pin 14
atabus0 at piixide0 channel 0
piixide0: secondary channel configured to compatibility mode
piixide0: secondary channel interrupting at ioapic0 pin 15
atabus1 at piixide0 channel 1
piixpm0 at pci0 dev 7 function 3: vendor 0x8086 product 0x7113 (rev. 0x08)
timecounter: Timecounter "piixpm0" frequency 3579545 Hz quality 1000
piixpm0: 24-bit timer
piixpm0: SMBus disabled
vendor 0x15ad product 0x0740 (miscellaneous system, revision 0x10) at pci0 dev 
7 function 7 not configured
vga0 at pci0 dev 15 function 0: vendor 0x15ad product 0x0405 (rev. 0x00)
wsdisplay0 at vga0 kbdmux 1: console (80x25, vt100 emulation), using wskbd0
wsmux1: connecting to wsdisplay0
drm at vga0 not configured
mpt has not been converted to device_t
mpt0 at pci0 dev 16 function 0: vendor 0x1000 product 0x0030 (rev. 0x01)
mpt0: applying 1030 quirk
mpt0: interrupting at ioapic0 pin 17
scsibus0 at mpt0: 16 targets, 8 luns per target
ppb1 at pci0 dev 17 function 0: vendor 0x15ad product 0x0790 (rev. 0x02)
pci2 at ppb1 bus 2
pci2: i/o space, memory space enabled, rd/line, wr/inv ok
wm0 at pci2 dev 0 function 0: Intel i82545EM 1000BASE-T Ethernet (rev. 0x01)
wm0: interrupting at ioapic0 pin 18
wm0: 32-bit 66MHz PCI bus
wm0: 256 word (8 address bits) MicroWire EEPROM
wm0: Ethernet address 00:50:56:a2:55:d0
makphy0 at wm0 phy 1: Marvell 88E1011 Gigabit PHY, rev. 3
makphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 
1000baseT-FDX, auto
ppb2 at pci0 dev 21 function 0: vendor 0x15ad product 0x07a0 (rev. 0x01)
ppb2: PCI Express 2.0 <Root Port of PCI-E Root Complex>
pci3 at ppb2 bus 3
pci3: i/o space, memory space enabled, rd/line, wr/inv ok
ppb3 at pci0 dev 21 function 1: vendor 0x15ad product 0x07a0 (rev. 0x01)
ppb3: PCI Express 2.0 <Root Port of PCI-E Root Complex>
pci4 at ppb3 bus 4
pci4: i/o space, memory space enabled, rd/line, wr/inv ok
ppb4 at pci0 dev 21 function 2: vendor 0x15ad product 0x07a0 (rev. 0x01)
ppb4: PCI Express 2.0 <Root Port of PCI-E Root Complex>
pci5 at ppb4 bus 5
pci5: i/o space, memory space enabled, rd/line, wr/inv ok
ppb5 at pci0 dev 21 function 3: vendor 0x15ad product 0x07a0 (rev. 0x01)
ppb5: PCI Express 2.0 <Root Port of PCI-E Root Complex>
pci6 at ppb5 bus 6
pci6: i/o space, memory space enabled, rd/line, wr/inv ok
ppb6 at pci0 dev 21 function 4: vendor 0x15ad product 0x07a0 (rev. 0x01)
ppb6: PCI Express 2.0 <Root Port of PCI-E Root Complex>
pci7 at ppb6 bus 7
pci7: i/o space, memory space enabled, rd/line, wr/inv ok
ppb7 at pci0 dev 21 function 5: vendor 0x15ad product 0x07a0 (rev. 0x01)
ppb7: PCI Express 2.0 <Root Port of PCI-E Root Complex>
pci8 at ppb7 bus 8
pci8: i/o space, memory space enabled, rd/line, wr/inv ok
ppb8 at pci0 dev 21 function 6: vendor 0x15ad product 0x07a0 (rev. 0x01)
ppb8: PCI Express 2.0 <Root Port of PCI-E Root Complex>
pci9 at ppb8 bus 9
pci9: i/o space, memory space enabled, rd/line, wr/inv ok
ppb9 at pci0 dev 21 function 7: vendor 0x15ad product 0x07a0 (rev. 0x01)
ppb9: PCI Express 2.0 <Root Port of PCI-E Root Complex>
pci10 at ppb9 bus 10
pci10: i/o space, memory space enabled, rd/line, wr/inv ok
ppb10 at pci0 dev 22 function 0: vendor 0x15ad product 0x07a0 (rev. 0x01)
ppb10: PCI Express 2.0 <Root Port of PCI-E Root Complex>
pci11 at ppb10 bus 11
pci11: i/o space, memory space enabled, rd/line, wr/inv ok
ppb11 at pci0 dev 22 function 1: vendor 0x15ad product 0x07a0 (rev. 0x01)
ppb11: PCI Express 2.0 <Root Port of PCI-E Root Complex>
pci12 at ppb11 bus 12
pci12: i/o space, memory space enabled, rd/line, wr/inv ok
ppb12 at pci0 dev 22 function 2: vendor 0x15ad product 0x07a0 (rev. 0x01)
ppb12: PCI Express 2.0 <Root Port of PCI-E Root Complex>
pci13 at ppb12 bus 13
pci13: i/o space, memory space enabled, rd/line, wr/inv ok
ppb13 at pci0 dev 22 function 3: vendor 0x15ad product 0x07a0 (rev. 0x01)
ppb13: PCI Express 2.0 <Root Port of PCI-E Root Complex>
pci14 at ppb13 bus 14
pci14: i/o space, memory space enabled, rd/line, wr/inv ok
ppb14 at pci0 dev 22 function 4: vendor 0x15ad product 0x07a0 (rev. 0x01)
ppb14: PCI Express 2.0 <Root Port of PCI-E Root Complex>
pci15 at ppb14 bus 15
pci15: i/o space, memory space enabled, rd/line, wr/inv ok
ppb15 at pci0 dev 22 function 5: vendor 0x15ad product 0x07a0 (rev. 0x01)
ppb15: PCI Express 2.0 <Root Port of PCI-E Root Complex>
pci16 at ppb15 bus 16
pci16: i/o space, memory space enabled, rd/line, wr/inv ok
ppb16 at pci0 dev 22 function 6: vendor 0x15ad product 0x07a0 (rev. 0x01)
ppb16: PCI Express 2.0 <Root Port of PCI-E Root Complex>
pci17 at ppb16 bus 17
pci17: i/o space, memory space enabled, rd/line, wr/inv ok
ppb17 at pci0 dev 22 function 7: vendor 0x15ad product 0x07a0 (rev. 0x01)
ppb17: PCI Express 2.0 <Root Port of PCI-E Root Complex>
pci18 at ppb17 bus 18
pci18: i/o space, memory space enabled, rd/line, wr/inv ok
ppb18 at pci0 dev 23 function 0: vendor 0x15ad product 0x07a0 (rev. 0x01)
ppb18: PCI Express 2.0 <Root Port of PCI-E Root Complex>
pci19 at ppb18 bus 19
pci19: i/o space, memory space enabled, rd/line, wr/inv ok
ppb19 at pci0 dev 23 function 1: vendor 0x15ad product 0x07a0 (rev. 0x01)
ppb19: PCI Express 2.0 <Root Port of PCI-E Root Complex>
pci20 at ppb19 bus 20
pci20: i/o space, memory space enabled, rd/line, wr/inv ok
ppb20 at pci0 dev 23 function 2: vendor 0x15ad product 0x07a0 (rev. 0x01)
ppb20: PCI Express 2.0 <Root Port of PCI-E Root Complex>
pci21 at ppb20 bus 21
pci21: i/o space, memory space enabled, rd/line, wr/inv ok
ppb21 at pci0 dev 23 function 3: vendor 0x15ad product 0x07a0 (rev. 0x01)
ppb21: PCI Express 2.0 <Root Port of PCI-E Root Complex>
pci22 at ppb21 bus 22
pci22: i/o space, memory space enabled, rd/line, wr/inv ok
ppb22 at pci0 dev 23 function 4: vendor 0x15ad product 0x07a0 (rev. 0x01)
ppb22: PCI Express 2.0 <Root Port of PCI-E Root Complex>
pci23 at ppb22 bus 23
pci23: i/o space, memory space enabled, rd/line, wr/inv ok
ppb23 at pci0 dev 23 function 5: vendor 0x15ad product 0x07a0 (rev. 0x01)
ppb23: PCI Express 2.0 <Root Port of PCI-E Root Complex>
pci24 at ppb23 bus 24
pci24: i/o space, memory space enabled, rd/line, wr/inv ok
ppb24 at pci0 dev 23 function 6: vendor 0x15ad product 0x07a0 (rev. 0x01)
ppb24: PCI Express 2.0 <Root Port of PCI-E Root Complex>
pci25 at ppb24 bus 25
pci25: i/o space, memory space enabled, rd/line, wr/inv ok
ppb25 at pci0 dev 23 function 7: vendor 0x15ad product 0x07a0 (rev. 0x01)
ppb25: PCI Express 2.0 <Root Port of PCI-E Root Complex>
pci26 at ppb25 bus 26
pci26: i/o space, memory space enabled, rd/line, wr/inv ok
ppb26 at pci0 dev 24 function 0: vendor 0x15ad product 0x07a0 (rev. 0x01)
ppb26: PCI Express 2.0 <Root Port of PCI-E Root Complex>
pci27 at ppb26 bus 27
pci27: i/o space, memory space enabled, rd/line, wr/inv ok
ppb27 at pci0 dev 24 function 1: vendor 0x15ad product 0x07a0 (rev. 0x01)
ppb27: PCI Express 2.0 <Root Port of PCI-E Root Complex>
pci28 at ppb27 bus 28
pci28: i/o space, memory space enabled, rd/line, wr/inv ok
ppb28 at pci0 dev 24 function 2: vendor 0x15ad product 0x07a0 (rev. 0x01)
ppb28: PCI Express 2.0 <Root Port of PCI-E Root Complex>
pci29 at ppb28 bus 29
pci29: i/o space, memory space enabled, rd/line, wr/inv ok
ppb29 at pci0 dev 24 function 3: vendor 0x15ad product 0x07a0 (rev. 0x01)
ppb29: PCI Express 2.0 <Root Port of PCI-E Root Complex>
pci30 at ppb29 bus 30
pci30: i/o space, memory space enabled, rd/line, wr/inv ok
ppb30 at pci0 dev 24 function 4: vendor 0x15ad product 0x07a0 (rev. 0x01)
ppb30: PCI Express 2.0 <Root Port of PCI-E Root Complex>
pci31 at ppb30 bus 31
pci31: i/o space, memory space enabled, rd/line, wr/inv ok
ppb31 at pci0 dev 24 function 5: vendor 0x15ad product 0x07a0 (rev. 0x01)
ppb31: PCI Express 2.0 <Root Port of PCI-E Root Complex>
pci32 at ppb31 bus 32
pci32: i/o space, memory space enabled, rd/line, wr/inv ok
ppb32 at pci0 dev 24 function 6: vendor 0x15ad product 0x07a0 (rev. 0x01)
ppb32: PCI Express 2.0 <Root Port of PCI-E Root Complex>
pci33 at ppb32 bus 33
pci33: i/o space, memory space enabled, rd/line, wr/inv ok
ppb33 at pci0 dev 24 function 7: vendor 0x15ad product 0x07a0 (rev. 0x01)
ppb33: PCI Express 2.0 <Root Port of PCI-E Root Complex>
pci34 at ppb33 bus 34
pci34: i/o space, memory space enabled, rd/line, wr/inv ok
isa0 at pcib0
lpt0 at isa0 port 0x378-0x37b irq 7
com0 at isa0 port 0x3f8-0x3ff irq 4: ns16550a, working fifo
com1 at isa0 port 0x2f8-0x2ff irq 3: ns16550a, working fifo
fdc0 at isa0 port 0x3f0-0x3f7 irq 6 drq 2
acpicpu0 at cpu0: ACPI CPU
acpicpu0: C1: HLT, lat   0 us, pow     0 mW
timecounter: Timecounter "clockinterrupt" frequency 100 Hz quality 0
timecounter: Timecounter "TSC" frequency 2492947560 Hz quality 3000
acpiacad0: AC adapter online.
scsibus0: waiting 2 seconds for devices to settle...
fd0 at fdc0 drive 0: 1.44MB, 80 cyl, 2 head, 18 sec
atapibus0 at atabus1: 2 targets
cd0 at atapibus0 drive 0: <VMware Virtual IDE CDROM Drive, 1000000000000000000, 
0000000> cdrom removable
cd0: 32-bit data port
cd0: drive supports PIO mode 4, DMA mode 2, Ultra-DMA mode 2 (Ultra/33)
cd0(piixide0:1:0): using PIO mode 4, Ultra-DMA mode 2 (Ultra/33) (using DMA)
sd0 at scsibus0 target 0 lun 0: <VMware, Virtual disk, 1.0> disk fixed
sd0: fabricating a geometry
sd0: 12288 MB, 12288 cyl, 64 head, 32 sec, 512 bytes/sect x 25165824 sectors
sd0: fabricating a geometry
sd0: sync (6.25ns offset 127), 16-bit (320.000MB/s) transfers, tagged queueing
sd1 at scsibus0 target 1 lun 0: <VMware, Virtual disk, 1.0> disk fixed
sd1: fabricating a geometry
sd1: 81920 MB, 81920 cyl, 64 head, 32 sec, 512 bytes/sect x 167772160 sectors
sd1: fabricating a geometry
sd1: sync (6.25ns offset 127), 16-bit (320.000MB/s) transfers, tagged queueing
Kernelized RAIDframe activated
pad0: outputs: 44100Hz, 16-bit, stereo
audio0 at pad0: half duplex, playback, capture
boot device: sd0
root on sd0a dumps on sd0b
root file system type: ffs
wsdisplay0: screen 1 added (80x25, vt100 emulation)
wsdisplay0: screen 2 added (80x25, vt100 emulation)
wsdisplay0: screen 3 added (80x25, vt100 emulation)
wsdisplay0: screen 4 added (80x25, vt100 emulation)
uvm_fault(0xffffffff80e78b20, 0x0, 1) -> e
fatal page fault in supervisor mode
trap type 6 code 0 rip ffffffff808034fa cs 8 rflags 10246 cr2  58 cpl 6 rsp 
fffffe8001c3c6c0
panic: trap
cpu0: Begin traceback...
printf_nolog() at netbsd:printf_nolog
startlwp() at netbsd:startlwp
alltraps() at netbsd:alltraps+0xa2
uvm_km_kmem_alloc() at netbsd:uvm_km_kmem_alloc+0x130
pool_page_alloc() at netbsd:pool_page_alloc+0x2c
pool_grow() at netbsd:pool_grow+0x34
pool_get() at netbsd:pool_get+0x82
scsipi_get_xs() at netbsd:scsipi_get_xs+0xcc
sdstart() at netbsd:sdstart+0x82
sdstrategy() at netbsd:sdstrategy+0x168
bdev_strategy() at netbsd:bdev_strategy+0x47
spec_strategy() at netbsd:spec_strategy+0x3b
VOP_STRATEGY() at netbsd:VOP_STRATEGY+0x33
bwrite() at netbsd:bwrite+0x1c9
VOP_BWRITE() at netbsd:VOP_BWRITE+0x30
wapbl_flush() at netbsd:wapbl_flush+0x827
ffs_sync() at netbsd:ffs_sync+0x2b7
VFS_SYNC() at netbsd:VFS_SYNC+0x1c
sync_fsync() at netbsd:sync_fsync+0x78
VOP_FSYNC() at netbsd:VOP_FSYNC+0x3e
sched_sync() at netbsd:sched_sync+0xef
cpu0: End traceback...
dumping to dev 4,1 offset 3670919
dump 255 254 253 252 251 250 249 248 247 246 245 244 243 242 241 240 239 238 
237 236 235 234 233 232 231 230 229 228 227 226 225 224 223
 222 221 220
 219 218 217 216 215 214 213 212 211 210 209 208 207 206 205 204 203 202 201 
200 199 198 197 196 195 194 193 192 191 190 189 188 187 186
 185 184 183
 182 181 180 179 178 177 176 175 174 173 172 171 170 169 168 167 166 165 164 
163 162 161 160 159 158 157 156 155 154 153 152 151 150 149
 148 147 146
 145 144 143 142 141 140 139 138 137 136 135 134 133 132 131 130 129 128 127 
126 125 124 123 122 121 120 119 118 117 116 115 114 113 112
 111 110 109
 108 107 106 105 104 103 102 101 100 99 98 97 96 95 94 93 92 91 90 89 88 87 86 
85 84 83 82 81 80 79 78 77 76 75 74 73 72 71 70 69 68 67 
66 65 64 63 6
2 61 60 59 58 57 56 55 54 53 52 51 50 49 48 47 46 45 44 43 42 41 40 39 38 37 36 
35 34 33 32 31 30 29 28 27 26 25 24 23 22 21 20 19 18 17
 16 15 14 13
 12 11 10 9 8 7 6 5 4 3 2 1

I think this is the second crash, via dmesg(8). Some timestamps during the boot 
output would be great :)

Skipping crash dump on recursive panic
panic: trap
cpu0: Begin traceback...
printf_nolog() at netbsd:printf_nolog
startlwp() at netbsd:startlwp
alltraps() at netbsd:alltraps+0xa2
uvm_km_kmem_alloc() at netbsd:uvm_km_kmem_alloc+0x130
pool_page_alloc() at netbsd:pool_page_alloc+0x2c
pool_grow() at netbsd:pool_grow+0x34
pool_get() at netbsd:pool_get+0x82
pool_cache_get_slow() at netbsd:pool_cache_get_slow+0x19a
pool_cache_get_paddr() at netbsd:pool_cache_get_paddr+0x20f
rnd_add_data_ts() at netbsd:rnd_add_data_ts+0xea
_rnd_add_uint32() at netbsd:_rnd_add_uint32+0x89
sddone() at netbsd:sddone+0x8b
scsipi_complete() at netbsd:scsipi_complete+0x114
scsipi_done() at netbsd:scsipi_done+0xf1
mpt_intr() at netbsd:mpt_intr+0x1fa
mpt_scsipi_request() at netbsd:mpt_scsipi_request+0x587
sddump() at netbsd:sddump+0x1f0
dumpsys_seg() at netbsd:dumpsys_seg+0xb9
dump_seg_iter() at netbsd:dump_seg_iter+0xfb
dodumpsys() at netbsd:dodumpsys+0x273
dumpsys() at netbsd:dumpsys+0x1d
vpanic() at netbsd:vpanic+0x1dd
printf_nolog() at netbsd:printf_nolog
startlwp() at netbsd:startlwp
alltraps() at netbsd:alltraps+0xa2
uvm_km_kmem_alloc() at netbsd:uvm_km_kmem_alloc+0x130
pool_page_alloc() at netbsd:pool_page_alloc+0x2c
pool_grow() at netbsd:pool_grow+0x34
pool_get() at netbsd:pool_get+0x82
pool_cache_get_slow() at netbsd:pool_cache_get_slow+0x19a
pool_cache_get_paddr() at netbsd:pool_cache_get_paddr+0x20f
getiobuf() at netbsd:getiobuf+0x23
uvm_swap_io() at netbsd:uvm_swap_io+0x64
swapcluster_flush() at netbsd:swapcluster_flush+0x53
uvm_pageout() at netbsd:uvm_pageout+0x357
cpu0: End traceback...
uvm_fault(0xffffffff80e78b20, 0x0, 1) -> e
fatal page fault in supervisor mode
trap type 6 code 0 rip ffffffff808034fa cs 8 rflags 10246 cr2  58 cpl 8 rsp 
fffffe8001c53810
Skipping crash dump on recursive panic
panic: trap
alltraps() at netbsd:alltraps+0xa2

Are 256 MB too small when using WAPBL? I have increased the memory of the VM 
and will repeat the compilations.
>How-To-Repeat:

>Fix: