Only 8 MB/sec write throughput with NetBSD 5.1 AMD64

To: tech-perform%netbsd.org@localhost
Subject: Only 8 MB/sec write throughput with NetBSD 5.1 AMD64
From: Ravishankar S <ravishankar.srinivasan%gmail.com@localhost>
Date: Sun, 9 Oct 2011 14:22:14 +0530
Hi,

I am trying to set up an FTP/Samba file server for serving media files
at home and I am seeing only 8MB/sec disk write throughput with NBSD
5.1 AMD64. Previously Windows 7 and Linux did 30 MB+/sec on the same
setup. I just did a simple dd to check

dd if=/dev/zero of=/store/test.img bs=1000K count=1000

Setup details:

Asus M3N78-EM Mobo with NVIDIA GeForce 8300 chipset and Nvidia gigabit
ethernet (nfe driver in use)
AMD Athlon X2 2.6Ghz, 8GB DDR2
750GB WD 7400 rpm drive with 16MB hardware cache
Currently / is 40GB and I created a /store partition of 100GB size for testing
GENERIC kernel with no changes

How can I improve the disk write performance? What other data can I
collect to troubleshoot?

During installation i asked installer  to format /store with FFS2 and
softdeps on (although i don't know why fstab shows just ffs??)

# NetBSD /etc/fstab
# See /usr/share/examples/fstab/ for more examples.
/dev/wd0a               /       ffs     rw               1 1
/dev/wd0b               none    swap    sw,dp            0 0
/dev/wd0e               /store  ffs     rw,softdep               1 2
kernfs          /kern   kernfs  rw
ptyfs           /dev/pts        ptyfs   rw
procfs          /proc   procfs  rw
/dev/cd0a               /cdrom  cd9660  ro,noauto

dmesg output:

Copyright (c) 1996, 1997, 1998, 1999, 2000, 2001, 2002, 2003, 2004, 2005,
    2006, 2007, 2008, 2009, 2010
    The NetBSD Foundation, Inc.  All rights reserved.
Copyright (c) 1982, 1986, 1989, 1991, 1993
    The Regents of the University of California.  All rights reserved.

NetBSD 5.1 (GENERIC) #0: Sat Nov  6 13:19:33 UTC 2010
        
builds%b6.netbsd.org@localhost:/home/builds/ab/netbsd-5-1-RELEASE/amd64/201011061943Z-obj/home/builds/ab/netbsd-5-1-RELEASE/src/sys/arch/amd64/compile/GENERIC
total memory = 8063 MB
avail memory = 7801 MB
timecounter: Timecounters tick every 10.000 msec
timecounter: Timecounter "i8254" frequency 1193182 Hz quality 100
SMBIOS rev. 2.5 @ 0x9f000 (71 entries)
System manufacturer System Product Name (System Version)
mainbus0 (root)
cpu0 at mainbus0 apid 0: AMD 686-class, 2600MHz, id 0x60fb2
cpu1 at mainbus0 apid 1: AMD 686-class, 2600MHz, id 0x60fb2
ioapic0 at mainbus0 apid 2: pa 0xfec00000, version 11, 24 pins
acpi0 at mainbus0: Intel ACPICA 20080321
acpi0: X/RSDT: OemId <091010,XSDT1510,20100910>, AslId <MSFT,00000097>
acpi0: SCI interrupting at int 9
acpi0: fixed-feature power button present
timecounter: Timecounter "ACPI-Fast" frequency 3579545 Hz quality 1000
ACPI-Fast 24-bit timer
pcppi1 at acpi0 (SPKR, PNP0800): io 0x61
midi0 at pcppi1: PC speaker (CPU-intensive output)
sysbeep0 at pcppi1
FDC (PNP0700) at acpi0 not configured
LPTE (PNP0400) at acpi0 not configured
aiboost0 at acpi0 (ASOC, ATK0110-16843024)
aiboost0: ASUS AI Boost Hardware monitor
hpet0 at acpi0 (HPET, PNP0103-0): mem 0xfed00000-0xfed00fff irq 2,8
timecounter: Timecounter "hpet0" frequency 25000000 Hz quality 2000
attimer1 at acpi0 (TMR, PNP0100): io 0x40-0x43
UAR1 (PNP0501) at acpi0 not configured
WMI0 (pnp0c14) at acpi0 not configured
WMI1 (pnp0c14) at acpi0 not configured
acpibut0 at acpi0 (PWRB, PNP0C0C-170): ACPI Power Button
attimer1: attached to pcppi1
pci0 at mainbus0 bus 0: configuration mode 1
pci0: i/o space, memory space enabled, rd/line, rd/mult, wr/inv ok
vendor 0x10de product 0x0754 (RAM memory, revision 0xa2) at pci0 dev 0
function 0 not configured
pcib0 at pci0 dev 1 function 0
pcib0: vendor 0x10de product 0x075c (rev. 0xa2)
vendor 0x10de product 0x0752 (SMBus serial bus, revision 0xa1) at pci0
dev 1 function 1 not configured
vendor 0x10de product 0x0751 (RAM memory, revision 0xa1) at pci0 dev 1
function 2 not configured
vendor 0x10de product 0x0753 (Co-processor processor, revision 0xa2)
at pci0 dev 1 function 3 not configured
vendor 0x10de product 0x0568 (RAM memory, revision 0xa1) at pci0 dev 1
function 4 not configured
ohci0 at pci0 dev 2 function 0: vendor 0x10de product 0x077b (rev. 0xa1)
LUB0: Picked IRQ 20 with weight 0
ohci0: interrupting at ioapic0 pin 20
ohci0: OHCI version 1.0, legacy support
usb0 at ohci0: USB revision 1.0
ehci0 at pci0 dev 2 function 1: vendor 0x10de product 0x077c (rev. 0xa1)
LUB2: Picked IRQ 21 with weight 0
ehci0: interrupting at ioapic0 pin 21
ehci0: BIOS has given up ownership
ehci0: EHCI version 1.0
ehci0: companion controller, 15 ports each: ohci0
usb1 at ehci0: USB revision 2.0
ohci1 at pci0 dev 4 function 0: vendor 0x10de product 0x077d (rev. 0xa1)
UB11: Picked IRQ 22 with weight 0
ohci1: interrupting at ioapic0 pin 22
ohci1: OHCI version 1.0, legacy support
usb2 at ohci1: USB revision 1.0
ehci1 at pci0 dev 4 function 1: vendor 0x10de product 0x077e (rev. 0xa1)
UB12: Picked IRQ 23 with weight 0
ehci1: interrupting at ioapic0 pin 23
ehci1: BIOS refuses to give up ownership, using force
ehci1: EHCI version 1.0
ehci1: companion controller, 15 ports each: ohci1
usb3 at ehci1: USB revision 2.0
viaide0 at pci0 dev 6 function 0
viaide0: NVIDIA MCP77 IDE Controller (rev. 0xa1)
viaide0: bus-master DMA support present
viaide0: primary channel configured to compatibility mode
viaide0: primary channel interrupting at ioapic0 pin 14
atabus0 at viaide0 channel 0
viaide0: secondary channel configured to compatibility mode
viaide0: secondary channel ignored (disabled)
azalia0 at pci0 dev 7 function 0: Generic High Definition Audio Controller
LAZA: Picked IRQ 20 with weight 1
azalia0: interrupting at ioapic0 pin 20
azalia0: host: 0x10de/0x0774 (rev. 161), HDA rev. 1.0
ppb0 at pci0 dev 8 function 0: vendor 0x10de product 0x075a (rev. 0xa1)
pci1 at ppb0 bus 1
pci1: no spaces enabled!
pciide0 at pci0 dev 9 function 0
pciide0: vendor 0x10de product 0x0ad0 (rev. 0xa2)
pciide0: bus-master DMA support present, but unused (no driver support)
pciide0: primary channel wired to native-PCI mode
LSA0: Picked IRQ 21 with weight 1
pciide0: using ioapic0 pin 21 for native-PCI interrupt
atabus1 at pciide0 channel 0
pciide0: secondary channel wired to native-PCI mode
atabus2 at pciide0 channel 1
nfe0 at pci0 dev 10 function 0: vendor 0x10de product 0x0760 (rev. 0xa2)
LMAC: Picked IRQ 22 with weight 1
nfe0: interrupting at ioapic0 pin 22
nfe0: Ethernet address 00:23:54:4f:d2:82
rgephy0 at nfe0 phy 3: RTL8169S/8110S/8211 1000BASE-T media interface, rev. 2
rgephy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT,
1000baseT-FDX, auto
ppb1 at pci0 dev 11 function 0: vendor 0x10de product 0x0569 (rev. 0xa1)
pci2 at ppb1 bus 2
pci2: i/o space, memory space enabled, rd/line, wr/inv ok
vga0 at pci2 dev 0 function 0: vendor 0x10de product 0x0848 (rev. 0xa2)
wsdisplay0 at vga0 kbdmux 1: console (80x25, vt100 emulation)
wsmux1: connecting to wsdisplay0
drm at vga0 not configured
ppb2 at pci0 dev 16 function 0: vendor 0x10de product 0x0778 (rev. 0xa1)
ppb2: unsupported PCI Express version
pci3 at ppb2 bus 3
pci3: no spaces enabled!
ppb3 at pci0 dev 18 function 0: vendor 0x10de product 0x075b (rev. 0xa1)
pci4 at ppb3 bus 4
pci4: no spaces enabled!
ppb4 at pci0 dev 19 function 0: vendor 0x10de product 0x077a (rev. 0xa1)
pci5 at ppb4 bus 5
pci5: memory space enabled, rd/line, wr/inv ok
fwohci0 at pci5 dev 0 function 0: vendor 0x197b product 0x2380 (rev. 0x00)
LN3A: Picked IRQ 16 with weight 0
fwohci0: interrupting at ioapic0 pin 16
fwohci0: OHCI version 1.10 (ROM=0)
fwohci0: No. of Isochronous channels is 4.
fwohci0: EUI64 00:1e:8c:00:01:98:8c:a1
fwohci0: Phy 1394a available S400, 2 ports.
fwohci0: fwphy_rddata: 0x5 loop=100, retry=100
fwohci0: fwphy_rddata: 0x2 loop=100, retry=100
fwohci0: Link S400, max_rec 2048 bytes.
ieee1394if0 at fwohci0: IEEE1394 bus
fwip0 at ieee1394if0: IP over IEEE1394
fwohci0: Initiate bus reset
fwohci0: fwphy_rddata: 0x1 loop=100, retry=100
fwohci0: fwphy_rddata: 0x1 loop=100, retry=100
pchb0 at pci0 dev 24 function 0
pchb0: vendor 0x1022 product 0x1100 (rev. 0x00)
pchb1 at pci0 dev 24 function 1
pchb1: vendor 0x1022 product 0x1101 (rev. 0x00)
pchb2 at pci0 dev 24 function 2
pchb2: vendor 0x1022 product 0x1102 (rev. 0x00)
amdtemp0 at pci0 dev 24 function 3
amdtemp0: AMD CPU Temperature Sensors (K8: core rev BH-G2, socket AM2)
isa0 at pcib0
lpt0 at isa0 port 0x378-0x37b irq 7
com0 at isa0 port 0x3f8-0x3ff irq 4: ns16550a, working fifo
pckbc0 at isa0 port 0x60-0x64
pckbd0 at pckbc0 (kbd slot)
pckbc0: using irq 1 for kbd slot
wskbd0 at pckbd0: console keyboard, using wsdisplay0
fdc0 at isa0 port 0x3f0-0x3f7 irq 6 drq 2
timecounter: Timecounter "clockinterrupt" frequency 100 Hz quality 0
azalia0: codec[0]: Realtek ALC888 (rev. 1.1), HDA rev. 1.0
azalia0: codec[3]: 0x10de/0x0002 (rev. 0.0), HDA rev. 1.0
audio0 at azalia0: full duplex, playback, capture, independent
fd0 at fdc0 drive 0: 1.44MB, 80 cyl, 2 head, 18 sec
uhub0 at usb0: vendor 0x10de OHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub0: 6 ports with 6 removable, self powered
uhub1 at usb1: vendor 0x10de EHCI root hub, class 9/0, rev 2.00/1.00, addr 1
uhub1: 6 ports with 6 removable, self powered
uhub2 at usb2: vendor 0x10de OHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub2: 6 ports with 6 removable, self powered
uhub3 at usb3: vendor 0x10de EHCI root hub, class 9/0, rev 2.00/1.00, addr 1
uhub3: 6 ports with 6 removable, self powered
wd0 at atabus1 drive 0: <ST3750640AS>
wd0: drive supports 16-sector PIO transfers, LBA48 addressing
wd0: 698 GB, 1453518 cyl, 16 head, 63 sec, 512 bytes/sect x 1465147055 sectors
wd0: drive supports PIO mode 4, DMA mode 2, Ultra-DMA mode 6 (Ultra/133)
wd1 at atabus1 drive 1: <WDC WD15EARS-00MVWB0>
wd1: drive supports 16-sector PIO transfers, LBA48 addressing
wd1: 1397 GB, 2907021 cyl, 16 head, 63 sec, 512 bytes/sect x 2930277168 sectors
wd1: drive supports PIO mode 4, DMA mode 2, Ultra-DMA mode 6 (Ultra/133)
wd2 at atabus2 drive 0: <WDC WD10EARS-00MVWB0>
wd2: drive supports 16-sector PIO transfers, LBA48 addressing
wd2: 931 GB, 1938021 cyl, 16 head, 63 sec, 512 bytes/sect x 1953525168 sectors
wd2: drive supports PIO mode 4, DMA mode 2, Ultra-DMA mode 6 (Ultra/133)
umass0 at uhub3 port 3 configuration 1 interface 0
umass0: USB2.0 External Mass Storage Device, rev 2.00/1.60, addr 2
umass0: using SCSI over Bulk-Only
scsibus0 at umass0: 2 targets, 1 lun per target
cd0 at scsibus0 target 0 lun 0: <slimtype, eSAU208   3, YL09> cdrom removable
Kernelized RAIDframe activated
pad0: outputs: 44100Hz, 16-bit, stereo
audio1 at pad0: half duplex, playback, capture
boot device: wd0
root on wd0a dumps on wd0b
root file system type: ffs
wsdisplay0: screen 1 added (80x25, vt100 emulation)
wsdisplay0: screen 2 added (80x25, vt100 emulation)
wsdisplay0: screen 3 added (80x25, vt100 emulation)
wsdisplay0: screen 4 added (80x25, vt100 emulation)

Thanks,
Ravi
Follow-Ups:
- Re: Only 8 MB/sec write throughput with NetBSD 5.1 AMD64
  - From: Manuel Bouyer
- Re: Only 8 MB/sec write throughput with NetBSD 5.1 AMD64
  - From: Joerg Sonnenberger
Prev by Date: Re: ping 64.233.207.8?
Next by Date: Re: Only 8 MB/sec write throughput with NetBSD 5.1 AMD64
Previous by Thread: which mid-sized servers are best for NetBSD-5.1?
Next by Thread: Re: Only 8 MB/sec write throughput with NetBSD 5.1 AMD64
Indexes:
Home | Main Index | Thread Index | Old Index