Re: NetBSD disk I/O

To: Martin Husemann <martin%duskware.de@localhost>
Subject: Re: NetBSD disk I/O
From: Sad Clouds <cryintothebluesky%gmail.com@localhost>
Date: Thu, 16 Aug 2018 14:10:03 +0100
On Tue, 14 Aug 2018 20:06:02 +0200
Martin Husemann <martin%duskware.de@localhost> wrote:

> On Tue, Aug 14, 2018 at 06:39:14PM +0100, Sad Clouds wrote:
> > Hello, in my case it's not just slow I/O, i.e. if they were both
> > slow on Linux and NetBSD VMs, then I would just accept it. However
> > on the same VirtualBox host, with the same VM settings, NetBSD I/O
> > is very slow, compared to Linux. There is a reason somewhere, I
> > just don't know what it is. OK I don't use NetBSD VMs for anything
> > critical, so I can cope, but it would be nice to have it much
> > faster.
> 
> The problem is that it is not eassily reproducable. We need to find
> out what is special in your tests.
> 
> Martin

I can give exact details of my VirtualBox host and I can provide Linux
and NetBSD VM images for anyone to import those and try it out, just
let me know.

Also I took snapshots of activity of VirtualBox threads while running
I/O tests on Linux and NetBSD:

while true; do top -H -b -n 1 | head -n 20 | tee -a vbox_netbsd.txt; sleep 0.5; done

So for Linux VM, VirtualBox LSILOGICSPI thread is running 99.9% on 
CPU, while for NetBSD it is running only 10-15% on CPU and also it 
seems to have more EMT threads running on CPUs


Linux:

top - 13:42:44 up 2 days, 17:26,  1 user,  load average: 0.20, 0.37, 0.40
Threads: 720 total,   4 running, 716 sleeping,   0 stopped,   0 zombie
%Cpu(s):  1.0 us,  0.5 sy,  0.0 ni, 98.4 id,  0.0 wa,  0.0 hi,  0.0 si,  0.0 st
KiB Mem : 49444040 total, 28623424 free, 19375084 used,  1445532 buff/cache
KiB Swap: 50331644 total, 50331644 free,        0 used. 29115524 avail Mem 

  PID USER      PR  NI    VIRT    RES    SHR S %CPU %MEM     TIME+ COMMAND
11593 XXXXX     20   0 10.585g 257408 175668 R 99.9  0.5   0:33.85 LSILOGICSPI-0
11578 XXXXX     20   0 10.585g 257408 175668 R 94.7  0.5   0:21.33 EMT-1
11584 XXXXX     20   0 10.585g 257408 175668 S 52.6  0.5   0:23.52 EMT-7
12361 XXXXX     20   0   45464   4316   3096 R 26.3  0.0   0:00.08 top
11579 XXXXX     20   0 10.585g 257408 175668 R 21.1  0.5   0:11.38 EMT-2
11529 XXXXX     20   0 10.409g 212656 138060 S  5.3  0.4   0:51.78 EMT-0
11536 XXXXX     20   0 10.409g 212656 138060 S  5.3  0.4   0:47.88 EMT-7
    1 root      20   0  204712   6940   5240 S  0.0  0.0   0:01.89 systemd
    2 root      20   0       0      0      0 S  0.0  0.0   0:00.03 kthreadd
    3 root      20   0       0      0      0 S  0.0  0.0   0:00.10 ksoftirqd/0
    5 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 kworker/0:0H
    6 root      20   0       0      0      0 S  0.0  0.0   0:00.31 kworker/u64:0
    8 root      20   0       0      0      0 S  0.0  0.0   0:06.60 rcu_sched

top - 13:42:45 up 2 days, 17:26,  1 user,  load average: 0.20, 0.37, 0.40
Threads: 720 total,   4 running, 716 sleeping,   0 stopped,   0 zombie
%Cpu(s):  1.0 us,  0.5 sy,  0.0 ni, 98.4 id,  0.0 wa,  0.0 hi,  0.0 si,  0.0 st
KiB Mem : 49444040 total, 28622032 free, 19376468 used,  1445540 buff/cache
KiB Swap: 50331644 total, 50331644 free,        0 used. 29114136 avail Mem 

  PID USER      PR  NI    VIRT    RES    SHR S %CPU %MEM     TIME+ COMMAND
11593 XXXXX     20   0 10.585g 257612 175668 R 94.7  0.5   0:34.57 LSILOGICSPI-0
11578 XXXXX     20   0 10.585g 257612 175668 R 89.5  0.5   0:22.03 EMT-1
11579 XXXXX     20   0 10.585g 257612 175668 S 47.4  0.5   0:11.71 EMT-2
12365 XXXXX     20   0   45464   4280   3060 R 26.3  0.0   0:00.08 top
11584 XXXXX     20   0 10.585g 257612 175668 S 21.1  0.5   0:23.70 EMT-7
 7153 XXXXX     20   0 2975160 273780 116856 S  5.3  0.6   3:32.09 opera
11200 XXXXX     20   0  984240  38292  21276 S  5.3  0.1   0:09.21 nspr-1
11562 XXXXX     20   0 10.585g 257612 175668 S  5.3  0.5   0:03.80 nspr-2
11566 XXXXX     20   0 10.585g 257612 175668 S  5.3  0.5   0:00.22 TimerLR
    1 root      20   0  204712   6940   5240 S  0.0  0.0   0:01.89 systemd
    2 root      20   0       0      0      0 S  0.0  0.0   0:00.03 kthreadd
    3 root      20   0       0      0      0 S  0.0  0.0   0:00.10 ksoftirqd/0
    5 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 kworker/0:0H

top - 13:42:46 up 2 days, 17:26,  1 user,  load average: 0.20, 0.37, 0.40
Threads: 720 total,   4 running, 716 sleeping,   0 stopped,   0 zombie
%Cpu(s):  1.0 us,  0.5 sy,  0.0 ni, 98.4 id,  0.0 wa,  0.0 hi,  0.0 si,  0.0 st
KiB Mem : 49444040 total, 28622256 free, 19376244 used,  1445540 buff/cache
KiB Swap: 50331644 total, 50331644 free,        0 used. 29114360 avail Mem 

  PID USER      PR  NI    VIRT    RES    SHR S %CPU %MEM     TIME+ COMMAND
11593 XXXXX     20   0 10.585g 257436 175668 R 95.0  0.5   0:35.29 LSILOGICSPI-0
11578 XXXXX     20   0 10.585g 257436 175668 R 90.0  0.5   0:22.70 EMT-1
11579 XXXXX     20   0 10.585g 257436 175668 R 45.0  0.5   0:12.03 EMT-2
11584 XXXXX     20   0 10.585g 257436 175668 S 25.0  0.5   0:23.88 EMT-7
12369 XXXXX     20   0   45464   4224   3004 R 20.0  0.0   0:00.08 top
11529 XXXXX     20   0 10.409g 212656 138060 S  5.0  0.4   0:51.80 EMT-0
11533 XXXXX     20   0 10.409g 212656 138060 S  5.0  0.4   0:28.13 EMT-4
11536 XXXXX     20   0 10.409g 212656 138060 S  5.0  0.4   0:47.92 EMT-7
    1 root      20   0  204712   6940   5240 S  0.0  0.0   0:01.89 systemd
    2 root      20   0       0      0      0 S  0.0  0.0   0:00.03 kthreadd
    3 root      20   0       0      0      0 S  0.0  0.0   0:00.10 ksoftirqd/0
    5 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 kworker/0:0H
    6 root      20   0       0      0      0 S  0.0  0.0   0:00.31 kworker/u64:0




NetBSD:

top - 13:44:04 up 2 days, 17:27,  1 user,  load average: 0.81, 0.47, 0.43
Threads: 720 total,   8 running, 712 sleeping,   0 stopped,   0 zombie
%Cpu(s):  1.0 us,  0.6 sy,  0.0 ni, 98.4 id,  0.0 wa,  0.0 hi,  0.0 si,  0.0 st
KiB Mem : 49444040 total, 28620272 free, 19378244 used,  1445524 buff/cache
KiB Swap: 50331644 total, 50331644 free,        0 used. 29112380 avail Mem 

  PID USER      PR  NI    VIRT    RES    SHR S %CPU %MEM     TIME+ COMMAND
11530 XXXXX     20   0 10.409g 212920 138060 R 95.2  0.4   0:34.46 EMT-1
11536 XXXXX     20   0 10.409g 212920 138060 R 76.2  0.4   0:52.16 EMT-7
11529 XXXXX     20   0 10.409g 212920 138060 R 71.4  0.4   0:55.46 EMT-0
11533 XXXXX     20   0 10.409g 212920 138060 R 66.7  0.4   0:31.12 EMT-4
11534 XXXXX     20   0 10.409g 212920 138060 R 66.7  0.4   0:32.89 EMT-5
11535 XXXXX     20   0 10.409g 212920 138060 R 66.7  0.4   0:36.42 EMT-6
11532 XXXXX     20   0 10.409g 212920 138060 S 61.9  0.4   0:32.77 EMT-3
11531 XXXXX     20   0 10.409g 212920 138060 R 57.1  0.4   0:33.44 EMT-2
12463 XXXXX     20   0   45464   4324   3104 R 23.8  0.0   0:00.10 top
11545 XXXXX     20   0 10.409g 212920 138060 S 14.3  0.4   0:03.40 LSILOGICSPI-0
  924 root      20   0       0      0      0 S  4.8  0.0   0:02.33 kworker/4:2
 6634 root      20   0       0      0      0 S  4.8  0.0   0:02.96 kworker/11:0
    1 root      20   0  204712   6940   5240 S  0.0  0.0   0:01.89 systemd

top - 13:44:04 up 2 days, 17:27,  1 user,  load average: 0.81, 0.47, 0.43
Threads: 720 total,   8 running, 712 sleeping,   0 stopped,   0 zombie
%Cpu(s):  1.0 us,  0.6 sy,  0.0 ni, 98.4 id,  0.0 wa,  0.0 hi,  0.0 si,  0.0 st
KiB Mem : 49444040 total, 28619828 free, 19378680 used,  1445532 buff/cache
KiB Swap: 50331644 total, 50331644 free,        0 used. 29111940 avail Mem 

  PID USER      PR  NI    VIRT    RES    SHR S %CPU %MEM     TIME+ COMMAND
11536 XXXXX     20   0 10.409g 212920 138060 R 94.7  0.4   0:52.84 EMT-7
11529 XXXXX     20   0 10.409g 212920 138060 R 84.2  0.4   0:56.01 EMT-0
11535 XXXXX     20   0 10.409g 212920 138060 R 78.9  0.4   0:36.99 EMT-6
11530 XXXXX     20   0 10.409g 212920 138060 R 73.7  0.4   0:35.06 EMT-1
11531 XXXXX     20   0 10.409g 212920 138060 R 73.7  0.4   0:33.95 EMT-2
11533 XXXXX     20   0 10.409g 212920 138060 R 73.7  0.4   0:31.66 EMT-4
11534 XXXXX     20   0 10.409g 212920 138060 R 73.7  0.4   0:33.44 EMT-5
11532 XXXXX     20   0 10.409g 212920 138060 S 63.2  0.4   0:33.27 EMT-3
12469 XXXXX     20   0   45464   4240   3016 R 21.1  0.0   0:00.07 top
11545 XXXXX     20   0 10.409g 212920 138060 S 10.5  0.4   0:03.50 LSILOGICSPI-0
 5815 root      20   0       0      0      0 S  5.3  0.0   0:01.88 kworker/15:1
11584 XXXXX     20   0 10.585g 257388 175668 S  5.3  0.5   0:26.76 EMT-7
    1 root      20   0  204712   6940   5240 S  0.0  0.0   0:01.89 systemd

top - 13:44:05 up 2 days, 17:27,  1 user,  load average: 0.81, 0.47, 0.43
Threads: 720 total,   5 running, 715 sleeping,   0 stopped,   0 zombie
%Cpu(s):  1.0 us,  0.6 sy,  0.0 ni, 98.4 id,  0.0 wa,  0.0 hi,  0.0 si,  0.0 st
KiB Mem : 49444040 total, 28619976 free, 19378532 used,  1445532 buff/cache
KiB Swap: 50331644 total, 50331644 free,        0 used. 29112088 avail Mem 

  PID USER      PR  NI    VIRT    RES    SHR S %CPU %MEM     TIME+ COMMAND
11536 XXXXX     20   0 10.409g 212920 138060 R 99.9  0.4   0:53.58 EMT-7
11530 XXXXX     20   0 10.409g 212920 138060 S 73.7  0.4   0:35.56 EMT-1
11531 XXXXX     20   0 10.409g 212920 138060 S 73.7  0.4   0:34.46 EMT-2
11533 XXXXX     20   0 10.409g 212920 138060 S 73.7  0.4   0:32.20 EMT-4
11534 XXXXX     20   0 10.409g 212920 138060 S 73.7  0.4   0:33.99 EMT-5
11535 XXXXX     20   0 10.409g 212920 138060 R 68.4  0.4   0:37.53 EMT-6
11529 XXXXX     20   0 10.409g 212920 138060 S 63.2  0.4   0:56.52 EMT-0
11532 XXXXX     20   0 10.409g 212920 138060 R 63.2  0.4   0:33.75 EMT-3
12473 XXXXX     20   0   45464   4312   3092 R 21.1  0.0   0:00.07 top
11545 XXXXX     20   0 10.409g 212920 138060 R 15.8  0.4   0:03.60 LSILOGICSPI-0
11610 XXXXX     20   0 10.409g 212920 138060 S  5.3  0.4   0:01.54 VUsbPeriodFrm
    1 root      20   0  204712   6940   5240 S  0.0  0.0   0:01.89 systemd
    2 root      20   0       0      0      0 S  0.0  0.0   0:00.03 kthreadd
References:
- NetBSD disk I/O
  - From: Andy Ball
- Re: NetBSD disk I/O
  - From: Sad Clouds
- Re: NetBSD disk I/O
  - From: Martin Husemann
Prev by Date: Re: NetBSD 8 error: Failure to communicate with kernel device-mapper driver
Next by Date: Re: NetBSD disk I/O
Previous by Thread: Re: NetBSD disk I/O
Next by Thread: Re: NetBSD disk I/O
Indexes:
Home | Main Index | Thread Index | Old Index