> We have some Dell R610s, with 4 bnx interfaces. We are finding that
> with netbsd-5/amd64 using a single bnx interface is stable. With two
> interfaces, the machine is very prone to a lockup. ctrl-alt-esc doesn't
> work, but an NMI gets into ddb. With netbsd-5/i386, all seems to be ok
> (once we raised NMBCLUSTERS).
How much memory does tha machine have?
The machine has 4G.
> Hints I've heard about this are disabling management firmware (tried
> that) and avoiding MSI-X (haven't figured that out).
We currently don't use MSI-X.
ok. I guess that's maybe an issue on some other systems - the bnx chips
seem to be generally trouble.
here's a dmesg in case that helps:
Copyright (c) 1996, 1997, 1998, 1999, 2000, 2001, 2002, 2003, 2004, 2005,
2006, 2007, 2008, 2009, 2010
The NetBSD Foundation, Inc. All rights reserved.
Copyright (c) 1982, 1986, 1989, 1991, 1993
The Regents of the University of California. All rights reserved.
NetBSD 5.1_RC3 (GENERIC) #2: Thu Jul 29 13:10:53 EDT 2010
fred%foo.bbn.com@localhost:/home/fred/bar/BUILD/baz/netbsd-5/amd64/sys/arch/amd64/compile/GENERIC
total memory = 4086 MB
avail memory = 3945 MB
timecounter: Timecounters tick every 10.000 msec
timecounter: Timecounter "i8254" frequency 1193182 Hz quality 100
SMBIOS rev. 2.6 @ 0xcf79c000 (83 entries)
Dell Inc. PowerEdge R610
mainbus0 (root)
cpu0 at mainbus0 apid 16: Intel 686-class, 1862MHz, id 0x106a5
cpu1 at mainbus0 apid 20: Intel 686-class, 1862MHz, id 0x106a5
ioapic0 at mainbus0 apid 0: pa 0xfec00000, version 20, 24 pins
ioapic1 at mainbus0 apid 1: pa 0xfec80000, version 20, 24 pins
acpi0 at mainbus0: Intel ACPICA 20080321
acpi0: X/RSDT: OemId <DELL ,PE_SC3 ,00000001>, AslId <DELL,00000001>
acpi0: SCI interrupting at int 9
acpi0: fixed-feature power button present
timecounter: Timecounter "ACPI-Safe" frequency 3579545 Hz quality 900
ACPI-Safe 24-bit timer
attimer1 at acpi0 (TMR, PNP0100): io 0x40-0x5f irq 0
COMA (PNP0501) at acpi0 not configured
COMB (PNP0501) at acpi0 not configured
hpet0 at acpi0 (HPET, PNP0103-0): mem 0xfed00000-0xfed003ff
timecounter: Timecounter "hpet0" frequency 14318179 Hz quality 2000
ipmi0 at mainbus0
pci0 at mainbus0 bus 0: configuration mode 1
pci0: i/o space, memory space enabled, rd/line, rd/mult, wr/inv ok
pchb0 at pci0 dev 0 function 0
pchb0: vendor 0x8086 product 0x3403 (rev. 0x13)
ppb0 at pci0 dev 1 function 0: vendor 0x8086 product 0x3408 (rev. 0x13)
ppb0: unsupported PCI Express version
pci1 at ppb0 bus 1
pci1: i/o space, memory space enabled, rd/line, wr/inv ok
bnx0 at pci1 dev 0 function 0: Broadcom NetXtreme II BCM5709 1000Base-T
bnx0: interrupting at ioapic1 pin 4
brgphy0 at bnx0 phy 1: BCM5709 10/100/1000baseT PHY, rev. 8
brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT,
1000baseT-FDX, auto
bnx1 at pci1 dev 0 function 1: Broadcom NetXtreme II BCM5709 1000Base-T
bnx1: interrupting at ioapic1 pin 16
brgphy1 at bnx1 phy 1: BCM5709 10/100/1000baseT PHY, rev. 8
brgphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT,
1000baseT-FDX, auto
ppb1 at pci0 dev 3 function 0: vendor 0x8086 product 0x340a (rev. 0x13)
ppb1: unsupported PCI Express version
pci2 at ppb1 bus 2
pci2: i/o space, memory space enabled, rd/line, wr/inv ok
bnx2 at pci2 dev 0 function 0: Broadcom NetXtreme II BCM5709 1000Base-T
bnx2: interrupting at ioapic1 pin 0
brgphy2 at bnx2 phy 1: BCM5709 10/100/1000baseT PHY, rev. 8
brgphy2: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT,
1000baseT-FDX, auto
bnx3 at pci2 dev 0 function 1: Broadcom NetXtreme II BCM5709 1000Base-T
bnx3: interrupting at ioapic1 pin 10
brgphy3 at bnx3 phy 1: BCM5709 10/100/1000baseT PHY, rev. 8
brgphy3: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT,
1000baseT-FDX, auto
ppb2 at pci0 dev 7 function 0: vendor 0x8086 product 0x340e (rev. 0x13)
ppb2: unsupported PCI Express version
pci3 at ppb2 bus 4
pci3: i/o space, memory space enabled, rd/line, wr/inv ok
ppb3 at pci3 dev 0 function 0: vendor 0x111d product 0x8018 (rev. 0x0e)
pci4 at ppb3 bus 5
pci4: i/o space, memory space enabled, rd/line, wr/inv ok
ppb4 at pci4 dev 2 function 0: vendor 0x111d product 0x8018 (rev. 0x0e)
pci5 at ppb4 bus 6
pci5: i/o space, memory space enabled, rd/line, wr/inv ok
wm0 at pci5 dev 0 function 0: 82576 quad-1000BaseT Ethernet, rev. 1
wm0: interrupting at ioapic1 pin 15
wm0: PCI-Express bus
wm0: 65536 word (16 address bits) SPI EEPROM
igphy0 at wm0 phy 1: i82566 10/100/1000 media interface, rev. 1
igphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT,
1000baseT-FDX, auto
wm1 at pci5 dev 0 function 1: 82576 quad-1000BaseT Ethernet, rev. 1
wm1: interrupting at ioapic1 pin 14
wm1: PCI-Express bus
wm1: 65536 word (16 address bits) SPI EEPROM
ppb5 at pci4 dev 4 function 0: vendor 0x111d product 0x8018 (rev. 0x0e)
pci6 at ppb5 bus 7
pci6: i/o space, memory space enabled, rd/line, wr/inv ok
wm2 at pci6 dev 0 function 0: 82576 quad-1000BaseT Ethernet, rev. 1
wm2: interrupting at ioapic1 pin 6
wm2: PCI-Express bus
wm2: 65536 word (16 address bits) SPI EEPROM
igphy1 at wm2 phy 1: i82566 10/100/1000 media interface, rev. 1
igphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT,
1000baseT-FDX, auto
wm3 at pci6 dev 0 function 1: 82576 quad-1000BaseT Ethernet, rev. 1
wm3: interrupting at ioapic1 pin 13
wm3: PCI-Express bus
wm3: 65536 word (16 address bits) SPI EEPROM
ppb6 at pci0 dev 9 function 0: vendor 0x8086 product 0x3410 (rev. 0x13)
ppb6: unsupported PCI Express version
pci7 at ppb6 bus 8
pci7: i/o space, memory space enabled, rd/line, wr/inv ok
vendor 0x8086 product 0x342e (interrupt system, revision 0x13) at pci0 dev 20
function 0 not configured
vendor 0x8086 product 0x3422 (interrupt system, revision 0x13) at pci0 dev 20
function 1 not configured
vendor 0x8086 product 0x3423 (interrupt system, revision 0x13) at pci0 dev 20
function 2 not configured
uhci0 at pci0 dev 26 function 0: vendor 0x8086 product 0x2937 (rev. 0x02)
uhci0: interrupting at ioapic0 pin 17
usb0 at uhci0: USB revision 1.0
uhci1 at pci0 dev 26 function 1: vendor 0x8086 product 0x2938 (rev. 0x02)
uhci1: interrupting at ioapic0 pin 18
usb1 at uhci1: USB revision 1.0
ehci0 at pci0 dev 26 function 7: vendor 0x8086 product 0x293c (rev. 0x02)
ehci0: interrupting at ioapic0 pin 19
ehci0: BIOS has given up ownership
ehci0: EHCI version 1.0
ehci0: companion controllers, 2 ports each: uhci0 uhci1
usb2 at ehci0: USB revision 2.0
ppb7 at pci0 dev 28 function 0: vendor 0x8086 product 0x2940 (rev. 0x02)
pci8 at ppb7 bus 3
pci8: i/o space, memory space enabled, rd/line, wr/inv ok
mpt0 at pci8 dev 0 function 0: vendor 0x1000 product 0x0058
mpt0: interrupting at ioapic0 pin 16
mpt0: Phy 0: Link Rate 3.0 Gbps
scsibus0 at mpt0: 112 targets, 8 luns per target
uhci2 at pci0 dev 29 function 0: vendor 0x8086 product 0x2934 (rev. 0x02)
uhci2: interrupting at ioapic0 pin 21
usb3 at uhci2: USB revision 1.0
uhci3 at pci0 dev 29 function 1: vendor 0x8086 product 0x2935 (rev. 0x02)
uhci3: interrupting at ioapic0 pin 20
usb4 at uhci3: USB revision 1.0
ehci1 at pci0 dev 29 function 7: vendor 0x8086 product 0x293a (rev. 0x02)
ehci1: interrupting at ioapic0 pin 21
ehci1: EHCI version 1.0
ehci1: companion controllers, 2 ports each: uhci2 uhci3
usb5 at ehci1: USB revision 2.0
ppb8 at pci0 dev 30 function 0: vendor 0x8086 product 0x244e (rev. 0x92)
pci9 at ppb8 bus 9
pci9: i/o space, memory space enabled
vga0 at pci9 dev 3 function 0: vendor 0x102b product 0x0532 (rev. 0x0a)
wsdisplay0 at vga0 kbdmux 1: console (80x25, vt100 emulation)
wsmux1: connecting to wsdisplay0
drm at vga0 not configured
ichlpcib0 at pci0 dev 31 function 0
ichlpcib0: vendor 0x8086 product 0x2918 (rev. 0x02)
timecounter: Timecounter "ichlpcib0" frequency 3579545 Hz quality 1000
ichlpcib0: 24-bit timer
ichlpcib0: TCO (watchdog) timer configured.
piixide0 at pci0 dev 31 function 2
piixide0: Intel 82801I Serial ATA Controller (ICH9) (rev. 0x02)
piixide0: bus-master DMA support present
piixide0: primary channel configured to native-PCI mode
piixide0: using ioapic0 pin 23 for native-PCI interrupt
atabus0 at piixide0 channel 0
piixide0: secondary channel configured to native-PCI mode
atabus1 at piixide0 channel 1
isa0 at ichlpcib0
com0 at isa0 port 0x3f8-0x3ff irq 4: ns16550a, working fifo
com1 at isa0 port 0x2f8-0x2ff irq 3: ns16550a, working fifo
pckbc0 at isa0 port 0x60-0x64
pckbd0 at pckbc0 (kbd slot)
pckbc0: using irq 1 for kbd slot
wskbd0 at pckbd0: console keyboard, using wsdisplay0
pcppi0 at isa0 port 0x61
midi0 at pcppi0: PC speaker (CPU-intensive output)
sysbeep0 at pcppi0
attimer1: attached to pcppi0
timecounter: Timecounter "clockinterrupt" frequency 100 Hz quality 0
timecounter: Timecounter "TSC" frequency 1862091280 Hz quality 3000
scsibus0: waiting 2 seconds for devices to settle...
uhub0 at usb0: vendor 0x8086 UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub0: 2 ports with 2 removable, self powered
uhub1 at usb1: vendor 0x8086 UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub1: 2 ports with 2 removable, self powered
uhub2 at usb2: vendor 0x8086 EHCI root hub, class 9/0, rev 2.00/1.00, addr 1
uhub2: 4 ports with 4 removable, self powered
uhub3 at usb3: vendor 0x8086 UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub3: 2 ports with 2 removable, self powered
uhub4 at usb4: vendor 0x8086 UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub4: 2 ports with 2 removable, self powered
uhub5 at usb5: vendor 0x8086 EHCI root hub, class 9/0, rev 2.00/1.00, addr 1
uhub5: 4 ports with 4 removable, self powered
uhub6 at uhub2 port 3: vendor 0x0424 product 0x2514, class 9/0, rev 2.00/0.00,
addr 2
uhub6: multiple transaction translators
uhub7 at uhub5 port 1: vendor 0x0409 product 0x005a, class 9/0, rev 2.00/1.00,
addr 2
uhub7: single transaction translator
uhub6: 3 ports with 3 removable, self powered
uhub7: 4 ports with 4 removable, self powered
sd0 at scsibus0 target 0 lun 0: <ATA, FUJITSU MHZ2080B, 8A22> disk fixed
sd0: 76319 MB, 76320 cyl, 16 head, 127 sec, 512 bytes/sect x 156301488 sectors
probe(mpt0:0:8:0): generic HBA error
uhidev0 at uhub7 port 1 configuration 1 interface 0
uhidev0: Microsoft Microsoft 3-Button Mouse with IntelliEye(TM), rev 1.10/3.00,
addr 3, iclass 3/1
ums0 at uhidev0: 3 buttons and Z dir
wsmouse0 at ums0 mux 0
uhidev1 at uhub7 port 2 configuration 1 interface 0
uhidev1: Microsoft Wired Keyboard 600, rev 1.10/1.10, addr 4, iclass 3/1
ukbd0 at uhidev1
wskbd1 at ukbd0 mux 1
wskbd1: connecting to wsdisplay0
uhidev2 at uhub7 port 2 configuration 1 interface 1
uhidev2: Microsoft Wired Keyboard 600, rev 1.10/1.10, addr 4, iclass 3/0
uhidev2: 3 report ids
uhid0 at uhidev2 reportid 1: input=7, output=0, feature=0
uhid1 at uhidev2 reportid 3: input=1, output=0, feature=0
uhidev3 at uhub3 port 2 configuration 1 interface 0
uhidev3: Avocent USB Composite Device-0, rev 1.10/0.00, addr 2, iclass 3/1
ukbd1 at uhidev3
wskbd2 at ukbd1 mux 1
wskbd2: connecting to wsdisplay0
uhidev4 at uhub3 port 2 configuration 1 interface 1
uhidev4: Avocent USB Composite Device-0, rev 1.10/0.00, addr 2, iclass 3/1
ums1 at uhidev4: 3 buttons and Z dir
wsmouse1 at ums1 mux 0
atapibus0 at atabus0: 2 targets
cd0 at atapibus0 drive 0: <TEAC DVD-ROM DV-28SW, 10020512162737, R.2A> cdrom
removable
cd0: 32-bit data port
cd0: drive supports PIO mode 4, DMA mode 2, Ultra-DMA mode 5 (Ultra/100)
cd0(piixide0:0:0): using PIO mode 4, Ultra-DMA mode 5 (Ultra/100) (using DMA)
ipmi0: version 2.0 interface KCS iobase 0xca8/8 spacing 4
Kernelized RAIDframe activated
pad0: outputs: 44100Hz, 16-bit, stereo
audio0 at pad0: half duplex, playback, capture
boot device: sd0
root on sd0a dumps on sd0b
root file system type: ffs
WARNING: clock gained 13 days
WARNING: CHECK AND RESET THE DATE!
wsdisplay0: screen 1 added (80x25, vt100 emulation)
wsdisplay0: screen 2 added (80x25, vt100 emulation)
wsdisplay0: screen 3 added (80x25, vt100 emulation)
wsdisplay0: screen 4 added (80x25, vt100 emulation)
Accounting started
ipmi0: critical over limit on 'Temp6'
Attachment:
pgpfhywBIE0IV.pgp
Description: PGP signature