Subject: more results: LMBENCH runs for SunOS-4 vs NetBSD-1.1 on Sun 3/260....
To: None <port-sun3@NetBSD.ORG>
From: Greg A. Woods <woods@most.weird.com>
List: port-sun3
Date: 06/10/1996 15:52:28
OK, I've finally run lmbench-1.1 on both machines in "single user" mode
(i.e. with nothing in the way except the portmap daemon, which lmbench
needs to do RPC testing).  NetBSD isn't looking very good yet.  :-(

The first two rows in each table are the ones to compare:

	most.1 is the SunOS-4.1.1_U1 3/260 w/48MB running in single user
	always.2 is the NetBSD-1.1 3/250 w/32MB running in single user

The other two rows are not so important -- I just had the data, so I
thought I'd throw it in to see how minimal multi-user services affect
things:

	most is the SunOS-4.1.1_U1 3/260 w/48MB running in multi-user
	always is the NetBSD-1.1 3/250 w/32MB running in multi-user

Ignore the "file reread".  It's atrocious because the NetBSD box has a
wimpy little old 100 MB Toshiba drive, and the SunOS box has a much
faster Quantum PD 1050S.  Refer to my older postings about filesystem
and raw disk performance to see identical disks compared between
NetBSD-1.1 and SunOS-4.1 (i.e. NetBSD is slower, but in weird ways).

Also note that Mmap re-read is probably far better under NetBSD simply
because NetBSD doesn't go to the trouble of keeping the filesystem
buffer cache in sync as SunOS does.

Oh, yeah, and I have confirmed that the timing loop used by lmbench is
not at all prepared to deal with the mc68020, thus the absurd 9MHz clock
frequency (it's really 25MHz).  I hope the main memory latency is
similarly off, but I won't guarantee it....


                L M B E N C H  1 . 0   S U M M A R Y
                ------------------------------------

                  Comparison to best of the breed
                  -------------------------------

                (Best numbers are starred, i.e., *123)


        Processor, Processes - factor slower than the best
        --------------------------------------------------
Host                 OS  Mhz    Null    Null  Simple /bin/sh  Mmap 2-proc 8-proc
                             Syscall Process Process Process   lat  ctxsw  ctxsw
--------- ------------- ---- ------- ------- ------- ------- ----- ------ ------
most.1    SunOS 4.1.1_U   10    *166  *29.9K *142.2K *231.6K *1368   *109    1.2
always.2     NetBSD 1.1   10     1.0     1.9     2.6     2.5   2.4    2.1   *458
most      SunOS 4.1.1_U   10     1.0     1.1     1.1     1.1   1.1    1.7    1.4
always       NetBSD 1.1   10     1.0     1.9     2.7     3.1   2.4    2.1    1.0

        *Local* Communication latencies - factor slower than the best
        -------------------------------------------------------------
Host                 OS  Pipe       UDP    RPC/     TCP    RPC/
                                            UDP             TCP
--------- ------------- ------- ------- ------- ------- -------
most.1    SunOS 4.1.1_U   *1089   *2227   *4244   *2608   *5336
always.2     NetBSD 1.1     1.2     1.3     1.7     1.4     1.5
most      SunOS 4.1.1_U     1.2     1.1     1.2     1.1     1.0
always       NetBSD 1.1     1.2     1.3     1.7     1.4     1.5

        *Local* Communication bandwidths - percentage of the best
        ---------------------------------------------------------
Host                 OS Pipe  TCP  File   Mmap  Bcopy  Bcopy  Mem   Mem
                                  reread reread (libc) (hand) read write
--------- ------------- ---- ---- ------ ------ ------ ------ ---- -----
most.1    SunOS 4.1.1_U   *1  77%     *2    77%     *3    96%   *7   97%
always.2     NetBSD 1.1  75%   *0    20%     *5    71%    99%  98%    *9
most      SunOS 4.1.1_U  89%  71%    97%    72%    95%    94%  96%   93%
always       NetBSD 1.1  73%   *0    20%    99%    72%     *4  99%   99%

            Memory latencies in nanoseconds - factor slower than the best
                    (WARNING - may not be correct, check graphs)
            -------------------------------------------------------------
Host                 OS   Mhz  L1 $   L2 $    Main mem    Guesses
--------- -------------   ---  ----   ----    --------    -------
most.1    SunOS 4.1.1_U     9   1.0    ???         1.0    No L2 cache?
always.2     NetBSD 1.1     9   1.0    ???        *948    No L2 cache?
most      SunOS 4.1.1_U     9  *137    ???         1.0    No L2 cache?
always       NetBSD 1.1     9   1.0    ???        *948    No L2 cache?


If anyone would like me to run different benchmarks on these systems,
please let me know.  As soon as I can afford another big disk, I'm going
to go to -current and try some kernel profiling....  I should probably
get a faster CPU for my server too if I'm going to be doing all this
stuff!  ;-)

-- 
							Greg A. Woods

+1 416 443-1734			VE3TCP			robohack!woods
Planix, Inc. <woods@planix.com>; Secrets of the Weird <woods@weird.com>