On Thu, 27 Oct 2005 05:47:42 -0700
Andy Ruhl <acruhl@gmail.com> wrote:

> On 10/27/05, Brett Lymn <blymn@baesystems.com.au> wrote:
> >
> > Folks,
> >
> > Last week I was at the AUUG 2005 conference where they had a Sun
> > Fire V40Z which was part of the display that Sun put on for the
> > conference.  On the last day we were allowed to install other
> > operating systems onto the beast - the OpenBSD guys put theirs on
> > (it worked FWIW), and I then installed NetBSD onto the machine,
> > cross built a MP on my laptop and booted to that.  With the short
> > testing I did NetBSD performed flawlessly on the machine.
> >
> > The machine specs were quad dual core opterons (8 cpus in other
> > words), 16Gb of RAM, two U320 SCSI hard drives.
> >
> > About the only problem I noticed was that top was not entirely happy
> > with displaying the memory size correctly - the amount of free
> > memory reported by top was off by a long way (an order of magnitude
> > or so). I think the problem is confined to top because vmstat
> > seemed to report the correct numbers...
> >
> > I copied over the base source and started a build.sh.
> > Unfortunately I omitted to copy over the X source as well so the
> > build.sh did not complete but the base source tree was built
> > entirely in roughly half an hour (this was with -j 16).  I would
> > estimate a full build.sh release would complete in about an hour or
> > so.
> >
> > Below is the dmesg.boot from the machine:
> >
> > Copyright (c) 1996, 1997, 1998, 1999, 2000, 2001, 2002, 2003, 2004,
> > 2005 The NetBSD Foundation, Inc.  All rights reserved.
> > Copyright (c) 1982, 1986, 1989, 1991, 1993
> >     The Regents of the University of California.  All rights
> > reserved.
> >
> > NetBSD 3.99.10 (GENERIC.MP) #1: Thu Oct 20 23:13:22 CST 2005
> >         toor@rover:/usr/obj/sys/arch/amd64/compile.amd64/GENERIC.MP
> > total memory = 15935 MB
> > avail memory = 15371 MB
> > mainbus0 (root)
> > mainbus0: Intel MP Specification (Version 1.4) (SUN      SunFire
> > V40z) cpu0 at mainbus0: apid 0 (boot processor)
> > cpu0: Dual Core AMD Opteron(tm) Processor 875, 2192.27 MHz
> > cpu0: features:
> > f7dbfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR> cpu0:
> > features: f7dbfbff<PGE,MCA,CMOV,PAT,PSE36,MPC,NOX,MMXX,MMX> cpu0:
> > features: f7dbfbff<FXSR,SSE,SSE2,B28,LONG,3DNOW2,3DNOW> cpu0:
> > I-cache 64 KB 64B/line 2-way, D-cache 64 KB 64B/line 2-way cpu0: L2
> > cache 1 MB 64B/line 16-way cpu0: ITLB 32 4 KB entries fully
> > associative, 8 4 MB entries fully associative cpu0: DTLB 32 4 KB
> > entries fully associative, 8 4 MB entries fully associative cpu0:
> > calibrating local timer cpu0: apic clock running at 199 MHz
> > cpu0: 16 page colors
> > cpu1 at mainbus0: apid 1 (application processor)
> > cpu1: starting
> > cpu1: Dual Core AMD Opteron(tm) Processor 875, 2192.15 MHz
> > cpu1: features:
> > f7dbfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR> cpu1:
> > features: f7dbfbff<PGE,MCA,CMOV,PAT,PSE36,MPC,NOX,MMXX,MMX> cpu1:
> > features: f7dbfbff<FXSR,SSE,SSE2,B28,LONG,3DNOW2,3DNOW> cpu1:
> > I-cache 64 KB 64B/line 2-way, D-cache 64 KB 64B/line 2-way cpu1: L2
> > cache 1 MB 64B/line 16-way cpu1: ITLB 32 4 KB entries fully
> > associative, 8 4 MB entries fully associative cpu1: DTLB 32 4 KB
> > entries fully associative, 8 4 MB entries fully associative cpu2 at
> > mainbus0: apid 2 (application processor) cpu2: starting
> > cpu2: Dual Core AMD Opteron(tm) Processor 875, 2192.15 MHz
> > cpu2: features:
> > f7dbfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR> cpu2:
> > features: f7dbfbff<PGE,MCA,CMOV,PAT,PSE36,MPC,NOX,MMXX,MMX> cpu2:
> > features: f7dbfbff<FXSR,SSE,SSE2,B28,LONG,3DNOW2,3DNOW> cpu2:
> > I-cache 64 KB 64B/line 2-way, D-cache 64 KB 64B/line 2-way cpu2: L2
> > cache 1 MB 64B/line 16-way cpu2: ITLB 32 4 KB entries fully
> > associative, 8 4 MB entries fully associative cpu2: DTLB 32 4 KB
> > entries fully associative, 8 4 MB entries fully associative cpu3 at
> > mainbus0: apid 3 (application processor) cpu3: starting
> > cpu3: Dual Core AMD Opteron(tm) Processor 875, 2192.15 MHz
> > cpu3: features:
> > f7dbfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR> cpu3:
> > features: f7dbfbff<PGE,MCA,CMOV,PAT,PSE36,MPC,NOX,MMXX,MMX> cpu3:
> > features: f7dbfbff<FXSR,SSE,SSE2,B28,LONG,3DNOW2,3DNOW> cpu3:
> > I-cache 64 KB 64B/line 2-way, D-cache 64 KB 64B/line 2-way cpu3: L2
> > cache 1 MB 64B/line 16-way cpu3: ITLB 32 4 KB entries fully
> > associative, 8 4 MB entries fully associative cpu3: DTLB 32 4 KB
> > entries fully associative, 8 4 MB entries fully associative cpu4 at
> > mainbus0: apid 4 (application processor) cpu4: starting
> > cpu4: Dual Core AMD Opteron(tm) Processor 875, 2192.15 MHz
> > cpu4: features:
> > f7dbfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR> cpu4:
> > features: f7dbfbff<PGE,MCA,CMOV,PAT,PSE36,MPC,NOX,MMXX,MMX> cpu4:
> > features: f7dbfbff<FXSR,SSE,SSE2,B28,LONG,3DNOW2,3DNOW> cpu4:
> > I-cache 64 KB 64B/line 2-way, D-cache 64 KB 64B/line 2-way cpu4: L2
> > cache 1 MB 64B/line 16-way cpu4: ITLB 32 4 KB entries fully
> > associative, 8 4 MB entries fully associative cpu4: DTLB 32 4 KB
> > entries fully associative, 8 4 MB entries fully associative cpu5 at
> > mainbus0: apid 5 (application processor) cpu5: starting
> > cpu5: Dual Core AMD Opteron(tm) Processor 875, 2192.15 MHz
> > cpu5: features:
> > f7dbfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR> cpu5:
> > features: f7dbfbff<PGE,MCA,CMOV,PAT,PSE36,MPC,NOX,MMXX,MMX> cpu5:
> > features: f7dbfbff<FXSR,SSE,SSE2,B28,LONG,3DNOW2,3DNOW> cpu5:
> > I-cache 64 KB 64B/line 2-way, D-cache 64 KB 64B/line 2-way cpu5: L2
> > cache 1 MB 64B/line 16-way cpu5: ITLB 32 4 KB entries fully
> > associative, 8 4 MB entries fully associative cpu5: DTLB 32 4 KB
> > entries fully associative, 8 4 MB entries fully associative cpu6 at
> > mainbus0: apid 6 (application processor) cpu6: starting
> > cpu6: Dual Core AMD Opteron(tm) Processor 875, 2192.15 MHz
> > cpu6: features:
> > f7dbfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR> cpu6:
> > features: f7dbfbff<PGE,MCA,CMOV,PAT,PSE36,MPC,NOX,MMXX,MMX> cpu6:
> > features: f7dbfbff<FXSR,SSE,SSE2,B28,LONG,3DNOW2,3DNOW> cpu6:
> > I-cache 64 KB 64B/line 2-way, D-cache 64 KB 64B/line 2-way cpu6: L2
> > cache 1 MB 64B/line 16-way cpu6: ITLB 32 4 KB entries fully
> > associative, 8 4 MB entries fully associative cpu6: DTLB 32 4 KB
> > entries fully associative, 8 4 MB entries fully associative cpu7 at
> > mainbus0: apid 7 (application processor) cpu7: starting
> > cpu7: Dual Core AMD Opteron(tm) Processor 875, 2192.15 MHz
> > cpu7: features:
> > f7dbfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR> cpu7:
> > features: f7dbfbff<PGE,MCA,CMOV,PAT,PSE36,MPC,NOX,MMXX,MMX> cpu7:
> > features: f7dbfbff<FXSR,SSE,SSE2,B28,LONG,3DNOW2,3DNOW> cpu7:
> > I-cache 64 KB 64B/line 2-way, D-cache 64 KB 64B/line 2-way cpu7: L2
> > cache 1 MB 64B/line 16-way cpu7: ITLB 32 4 KB entries fully
> > associative, 8 4 MB entries fully associative cpu7: DTLB 32 4 KB
> > entries fully associative, 8 4 MB entries fully associative mpbios:
> > bus 0 is type PCI mpbios: bus 1 is type PCI
> > mpbios: bus 2 is type PCI
> > mpbios: bus 3 is type PCI
> > mpbios: bus 32 is type PCI
> > mpbios: bus 33 is type PCI
> > mpbios: bus 37 is type PCI
> > mpbios: bus 41 is type PCI
> > mpbios: bus 45 is type PCI
> > mpbios: bus 49 is type ISA
> > ioapic0 at mainbus0 apid 8 (I/O APIC)
> > ioapic0: pa 0xfec00000, version 11, 24 pins
> > ioapic1 at mainbus0 apid 9 (I/O APIC)
> > ioapic1: pa 0xe4000000, version 11, 4 pins
> > ioapic2 at mainbus0 apid 10 (I/O APIC)
> > ioapic2: pa 0xe4001000, version 11, 4 pins
> > ioapic3 at mainbus0 apid 11 (I/O APIC)
> > ioapic3: pa 0xe5b01000, version 11, 4 pins
> > ioapic4 at mainbus0 apid 12 (I/O APIC)
> > ioapic4: pa 0xe5b03000, version 11, 4 pins
> > ioapic5 at mainbus0 apid 13 (I/O APIC)
> > ioapic5: pa 0xe5b05000, version 11, 4 pins
> > ioapic6 at mainbus0 apid 14 (I/O APIC)
> > ioapic6: pa 0xe5b07000, version 11, 4 pins
> > pci0 at mainbus0 bus 0: configuration mode 1
> > pci0: i/o space, memory space enabled, rd/line, rd/mult, wr/inv ok
> > ppb0 at pci0 dev 6 function 0: Advanced Micro Devices AMD8111 I/O
> > Hub (rev. 0x07) pci1 at ppb0 bus 1
> > pci1: i/o space, memory space enabled
> > ohci0 at pci1 dev 0 function 0: Advanced Micro Devices AMD8111 USB
> > Host Controller (rev. 0x0b) ohci0: interrupting at ioapic0 pin 19
> > (irq 11) ohci0: OHCI version 1.0, legacy support
> > usb0 at ohci0: USB revision 1.0
> > uhub0 at usb0
> > uhub0: Advanced Micro OHCI root hub, class 9/0, rev 1.00/1.00, addr
> > 1 uhub0: 3 ports with 3 removable, self powered
> > ohci1 at pci1 dev 0 function 1: Advanced Micro Devices AMD8111 USB
> > Host Controller (rev. 0x0b) ohci1: interrupting at ioapic0 pin 19
> > (irq 11) ohci1: OHCI version 1.0, legacy support
> > usb1 at ohci1: USB revision 1.0
> > uhub1 at usb1
> > uhub1: Advanced Micro OHCI root hub, class 9/0, rev 1.00/1.00, addr
> > 1 uhub1: 3 ports with 3 removable, self powered
> > vga0 at pci1 dev 5 function 0: Trident Microsystems product 0x9880
> > (rev. 0x3a) wsdisplay0 at vga0 kbdmux 1: console (80x25, vt100
> > emulation) wsmux1: connecting to wsdisplay0
> > pcib0 at pci0 dev 7 function 0
> > pcib0: Advanced Micro Devices AMD8111 LPC Controller (rev. 0x05)
> > viaide0 at pci0 dev 7 function 1
> > viaide0: Advanced Micro Devices AMD8111 IDE Controller (rev. 0x03)
> > viaide0: bus-master DMA support present
> > viaide0: primary channel configured to compatibility mode
> > viaide0: primary channel interrupting at ioapic0 pin 14 (irq 14)
> > atabus0 at viaide0 channel 0
> > viaide0: secondary channel configured to compatibility mode
> > viaide0: secondary channel interrupting at ioapic0 pin 15 (irq 15)
> > atabus1 at viaide0 channel 1
> > Advanced Micro Devices AMD8111 ACPI Controller (miscellaneous
> > bridge, revision 0x05) at pci0 dev 7 function 3 not configured ppb1
> > at pci0 dev 10 function 0: Advanced Micro Devices AMD8131 PCI-X
> > Tunnel (rev. 0x12) pci2 at ppb1 bus 2 pci2: i/o space, memory space
> > enabled bge0 at pci2 dev 2 function 0: Broadcom BCM5704C Dual
> > Gigabit Ethernet bge0: interrupting at ioapic1 pin 1 (irq 5)
> > bge0: ASIC BCM5704 A3 (0x2003), Ethernet address 00:09:3d:12:e7:0a
> > brgphy0 at bge0 phy 1: BCM5704 1000BASE-T media interface, rev. 0
> > brgphy0: using BCM5704 DSP patch
> > brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT,
> > 1000baseT-FDX, auto bge1 at pci2 dev 2 function 1: Broadcom
> > BCM5704C Dual Gigabit Ethernet bge1: interrupting at ioapic1 pin 2
> > (irq 7) bge1: ASIC BCM5704 A3 (0x2003), Ethernet address
> > 00:09:3d:12:e7:0b brgphy1 at bge1 phy 1: BCM5704 1000BASE-T media
> > interface, rev. 0 brgphy1: using BCM5704 DSP patch
> > brgphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT,
> > 1000baseT-FDX, auto mpt0 at pci2 dev 4 function 0: LSI Logic
> > 53c1030 Ultra320 SCSI mpt0: interrupting at ioapic1 pin 3 (irq 11)
> > scsibus0 at mpt0: 16 targets, 8 luns per target
> > aapic0 at pci0 dev 10 function 1: Advanced Micro Devices AMD8131 IO
> > Apic (rev. 0x01) ppb2 at pci0 dev 11 function 0: Advanced Micro
> > Devices AMD8131 PCI-X Tunnel (rev. 0x12) pci3 at ppb2 bus 3
> > pci3: i/o space, memory space enabled
> > aapic1 at pci0 dev 11 function 1: Advanced Micro Devices AMD8131 IO
> > Apic (rev. 0x01) pchb0 at pci0 dev 24 function 0
> > pchb0: Advanced Micro Devices AMD64 HyperTransport configuration
> > (rev. 0x00) pchb1 at pci0 dev 24 function 1
> > pchb1: Advanced Micro Devices AMD64 Address Map configuration (rev.
> > 0x00) pchb2 at pci0 dev 24 function 2
> > pchb2: Advanced Micro Devices AMD64 DRAM configuration (rev. 0x00)
> > pchb3 at pci0 dev 24 function 3
> > pchb3: Advanced Micro Devices AMD64 Miscellaneous configuration
> > (rev. 0x00) pchb4 at pci0 dev 25 function 0
> > pchb4: Advanced Micro Devices AMD64 HyperTransport configuration
> > (rev. 0x00) pchb5 at pci0 dev 25 function 1
> > pchb5: Advanced Micro Devices AMD64 Address Map configuration (rev.
> > 0x00) pchb6 at pci0 dev 25 function 2
> > pchb6: Advanced Micro Devices AMD64 DRAM configuration (rev. 0x00)
> > pchb7 at pci0 dev 25 function 3
> > pchb7: Advanced Micro Devices AMD64 Miscellaneous configuration
> > (rev. 0x00) pchb8 at pci0 dev 26 function 0
> > pchb8: Advanced Micro Devices AMD64 HyperTransport configuration
> > (rev. 0x00) pchb9 at pci0 dev 26 function 1
> > pchb9: Advanced Micro Devices AMD64 Address Map configuration (rev.
> > 0x00) pchb10 at pci0 dev 26 function 2
> > pchb10: Advanced Micro Devices AMD64 DRAM configuration (rev. 0x00)
> > pchb11 at pci0 dev 26 function 3
> > pchb11: Advanced Micro Devices AMD64 Miscellaneous configuration
> > (rev. 0x00) pchb12 at pci0 dev 27 function 0
> > pchb12: Advanced Micro Devices AMD64 HyperTransport configuration
> > (rev. 0x00) pchb13 at pci0 dev 27 function 1
> > pchb13: Advanced Micro Devices AMD64 Address Map configuration
> > (rev. 0x00) pchb14 at pci0 dev 27 function 2
> > pchb14: Advanced Micro Devices AMD64 DRAM configuration (rev. 0x00)
> > pchb15 at pci0 dev 27 function 3
> > pchb15: Advanced Micro Devices AMD64 Miscellaneous configuration
> > (rev. 0x00) isa0 at pcib0
> > com0 at isa0 port 0x3f8-0x3ff irq 4: ns16550a, working fifo
> > com1 at isa0 port 0x2f8-0x2ff irq 3: ns16550a, working fifo
> > pckbc0 at isa0 port 0x60-0x64
> > pckbd0 at pckbc0 (kbd slot)
> > pckbc0: using irq 1 for kbd slot
> > wskbd0 at pckbd0: console keyboard, using wsdisplay0
> > attimer0 at isa0 port 0x40-0x43: AT Timer
> > pcppi0 at isa0 port 0x61
> > midi0 at pcppi0: PC speaker
> > sysbeep0 at pcppi0
> > fdc0 at isa0 port 0x3f0-0x3f7 irq 6 drq 2
> > pcppi0: attached to attimer0
> > pci4 at mainbus0 bus 32
> > pci4: i/o space, memory space enabled, rd/line, rd/mult, wr/inv ok
> > ppb3 at pci4 dev 1 function 0: Advanced Micro Devices AMD8131 PCI-X
> > Tunnel (rev. 0x12) pci5 at ppb3 bus 33
> > pci5: i/o space, memory space enabled
> > aapic2 at pci4 dev 1 function 1: Advanced Micro Devices AMD8131 IO
> > Apic (rev. 0x01) ppb4 at pci4 dev 2 function 0: Advanced Micro
> > Devices AMD8131 PCI-X Tunnel (rev. 0x12) pci6 at ppb4 bus 37
> > pci6: i/o space, memory space enabled
> > aapic3 at pci4 dev 2 function 1: Advanced Micro Devices AMD8131 IO
> > Apic (rev. 0x01) ppb5 at pci4 dev 3 function 0: Advanced Micro
> > Devices AMD8131 PCI-X Tunnel (rev. 0x12) pci7 at ppb5 bus 41
> > pci7: i/o space, memory space enabled
> > aapic4 at pci4 dev 3 function 1: Advanced Micro Devices AMD8131 IO
> > Apic (rev. 0x01) ppb6 at pci4 dev 4 function 0: Advanced Micro
> > Devices AMD8131 PCI-X Tunnel (rev. 0x12) pci8 at ppb6 bus 45
> > pci8: i/o space, memory space enabled
> > aapic5 at pci4 dev 4 function 1: Advanced Micro Devices AMD8131 IO
> > Apic (rev. 0x01) ioapic0: enabling
> > ioapic1: enabling
> > ioapic2: enabling
> > ioapic3: enabling
> > ioapic4: enabling
> > ioapic5: enabling
> > ioapic6: enabling
> > fd0 at fdc0 drive 0: 1.44MB, 80 cyl, 2 head, 18 sec
> > Kernelized RAIDframe activated
> > scsibus0: waiting 2 seconds for devices to settle...
> > atapibus0 at atabus1: 2 targets
> > cd0 at atapibus0 drive 0: <MATSHITADVD-ROM SR-8178, , PY19> cdrom
> > removable cd0: 32-bit data port
> > cd0: drive supports PIO mode 4, DMA mode 2, Ultra-DMA mode 2
> > (Ultra/33) cd0(viaide0:1:0): using PIO mode 4, Ultra-DMA mode 2
> > (Ultra/33) (using DMA) uhidev0 at uhub0 port 1 configuration 1
> > interface 0 uhidev0: Sun Microsystems Type 6 USB keyboard, rev
> > 1.10/2.00, addr 2, iclass 3/1 ukbd0 at uhidev0
> > wskbd1 at ukbd0 mux 1
> > wskbd1: connecting to wsdisplay0
> > sd0 at scsibus0 target 0 lun 0: <FUJITSU, MAT3073NC, 0104> disk
> > fixed sd0: 70136 MB, 78753 cyl, 2 head, 911 sec, 512 bytes/sect x
> > 143638992 sectors sd0: sync (6.25ns offset 127), 16-bit
> > (320.000MB/s) transfers, tagged queueing sd1 at scsibus0 target 1
> > lun 0: <FUJITSU, MAT3073NC, 0104> disk fixed sd1: 70136 MB, 78753
> > cyl, 2 head, 911 sec, 512 bytes/sect x 143638992 sectors sd1: sync
> > (6.25ns offset 127), 16-bit (320.000MB/s) transfers, tagged
> > queueing ses0 at scsibus0 target 6 lun 0: <SDR, GEM318P, 1>
> > processor fixed ses0: SAF-TE Compliant Device ses0: async, 8-bit
> > transfers boot device: sd0
> > root on sd0a dumps on sd0b
> > root file system type: ffs
> > cpu1: CPU 1 running
> > cpu2: CPU 2 running
> > cpu3: CPU 3 running
> > cpu4: CPU 4 running
> > cpu5: CPU 5 running
> > cpu6: CPU 6 running
> > cpu7: CPU 7 running
> > wsdisplay0: screen 1 added (80x25, vt100 emulation)
> > wsdisplay0: screen 2 added (80x25, vt100 emulation)
> > wsdisplay0: screen 3 added (80x25, vt100 emulation)
> > wsdisplay0: screen 4 added (80x25, vt100 emulation)
> 
> Very cool! That's the most CPUs I've ever seen in a NetBSD dmesg.
> 
> I could play some serious mp3's with that thing :)

Like Mozart or Bach? 
I am not so sure Sun thought of that user group creating this server.
But yeah, what an impressive beast it is. It's propably made for the
new Windows Vista desktop users in mind.
:)

Cheers,
Marcin.