Re: mec(4) TX improvement and mbuf statistics

[Martin Husemann <martin%duskware.de@localhost>]

Here are my results with your patch (and the cpuflags you suggested, on
both machines)

Martin

On a R10K O2:

tequila-sunrise# ttcp -ts -n 10000 porter
ttcp-t: buflen=8192, nbuf=10000, align=16384/0, port=5001  tcp  -> porter
ttcp-t: socket
ttcp-t: connect
ttcp-t: 81920000 bytes in 8.29 real seconds = 9654.47 KB/sec +++
ttcp-t: 10000 I/O calls, msec/call = 0.85, calls/sec = 1206.81
ttcp-t: 0.0user 5.7sys 0:08real 69% 0i+0d 0maxrss 0+1pf 2527+18csw
tequila-sunrise# ttcp -tsu -n 10000 porter
ttcp-t: buflen=8192, nbuf=10000, align=16384/0, port=5001  udp  -> porter
ttcp-t: socket
ttcp-t: 81920000 bytes in 6.81 real seconds = 11744.30 KB/sec +++
ttcp-t: 10080 I/O calls, msec/call = 0.69, calls/sec = 1479.78
ttcp-t: 0.0user 4.8sys 0:06real 71% 0i+0d 0maxrss 0+1pf 74+20csw

mec0 TX pkts queued total                    296540      346 misc
mec0 TX pkts padded in txdesc buf                23        0 misc
mec0 TX pkts copied to txdesc buf               480        0 misc
mec0 TX pkts using concat ptr1                92855      108 misc
mec0 TX pkts  w/ptr1  ~160bytes                 109        0 misc
mec0 TX pkts  w/ptr1  ~256bytes                 107        0 misc
mec0 TX pkts  w/ptr1  ~512bytes                  18        0 misc
mec0 TX pkts  w/ptr1 ~1024bytes                  45        0 misc
mec0 TX pkts  w/ptr1 >1024bytes               92578      108 misc
mec0 TX pkts using concat ptr1,2             179451      209 misc
mec0 TX pkts  w/ptr2  ~160bytes                 221        0 misc
mec0 TX pkts  w/ptr2  ~256bytes                2281        2 misc
mec0 TX pkts  w/ptr2  ~512bytes                  34        0 misc
mec0 TX pkts  w/ptr2 ~1024bytes               30001       35 misc
mec0 TX pkts  w/ptr2 >1024bytes              146914      171 misc
mec0 TX pkts using concat ptr1,2,3             8596       10 misc
mec0 TX pkts  w/ptr3  ~512bytes                  12        0 misc
mec0 TX pkts  w/ptr3 ~1024bytes                  48        0 misc
mec0 TX pkts  w/ptr3 >1024bytes                8536        9 misc
mec0 TX pkts copied to new mbufs              15138       17 misc
mec0 TX pkts  w/mbuf ~1024bytes                   2        0 misc
mec0 TX pkts  w/mbuf >1024bytes               15136       17 misc
mec0 TX pkts using ptrs total                280921      327 misc
mec0 TX pkts  w/ptrs no hdr chain               220        0 misc
mec0 TX pkts  w/ptrs  1 hdr chain            280110      326 misc
mec0 TX pkts  w/ptrs  2 hdr chains              592        0 misc
mec0 TX pkts  w/ptrs  ~8bytes hdr               223        0 misc
mec0 TX pkts  w/ptrs ~32bytes hdr             30002       35 misc
mec0 TX pkts  w/ptrs ~64bytes hdr            152544      177 misc
mec0 TX pkts  w/ptrs ~80bytes hdr             97818      114 misc
mec0 TX pkts  w/ptrs ~96bytes hdr               338        0 misc
mec0 TX stalled due to no txdesc              22319       26 misc
mec0 TX empty interrupts                      22491       26 misc
mec0 TX sent interrupts                       22462       26 misc

On a R5K O2:
red-moon# ttcp -ts -n 10000 porter
ttcp-t: buflen=8192, nbuf=10000, align=16384/0, port=5001  tcp  -> porter
ttcp-t: socket
ttcp-t: connect
ttcp-t: 81920000 bytes in 8.27 real seconds = 9677.16 KB/sec +++
ttcp-t: 10000 I/O calls, msec/call = 0.85, calls/sec = 1209.64
ttcp-t: 0.0user 4.9sys 0:08real 59% 0i+0d 0maxrss 0+1pf 2529+13csw
red-moon# ttcp -tsu -n 10000 porter
ttcp-t: buflen=8192, nbuf=10000, align=16384/0, port=5001  udp  -> porter
ttcp-t: socket
ttcp-t: 81920000 bytes in 6.81 real seconds = 11747.68 KB/sec +++
ttcp-t: 10141 I/O calls, msec/call = 0.69, calls/sec = 1489.17
ttcp-t: 0.0user 3.2sys 0:06real 48% 0i+0d 0maxrss 0+1pf 135+15csw

mec0 TX pkts queued total                    119472      113 misc
mec0 TX pkts padded in txdesc buf                11        0 misc
mec0 TX pkts copied to txdesc buf               299        0 misc
mec0 TX pkts using concat ptr1                38231       36 misc
mec0 TX pkts  w/ptr1  ~160bytes                  41        0 misc
mec0 TX pkts  w/ptr1  ~256bytes                  46        0 misc
mec0 TX pkts  w/ptr1  ~512bytes                   4        0 misc
mec0 TX pkts  w/ptr1 ~1024bytes                  32        0 misc
mec0 TX pkts  w/ptr1 >1024bytes               38110       36 misc
mec0 TX pkts using concat ptr1,2              77754       73 misc
mec0 TX pkts  w/ptr2  ~160bytes                 215        0 misc
mec0 TX pkts  w/ptr2  ~256bytes                2246        2 misc
mec0 TX pkts  w/ptr2  ~512bytes                   7        0 misc
mec0 TX pkts  w/ptr2 ~1024bytes               10000        9 misc
mec0 TX pkts  w/ptr2 >1024bytes               65286       61 misc
mec0 TX pkts using concat ptr1,2,3              921        0 misc
mec0 TX pkts  w/ptr3  ~512bytes                   2        0 misc
mec0 TX pkts  w/ptr3 ~1024bytes                   1        0 misc
mec0 TX pkts  w/ptr3 >1024bytes                 918        0 misc
mec0 TX pkts copied to new mbufs               2259        2 misc
mec0 TX pkts  w/mbuf ~1024bytes                   2        0 misc
mec0 TX pkts  w/mbuf >1024bytes                2257        2 misc
mec0 TX pkts using ptrs total                116925      110 misc
mec0 TX pkts  w/ptrs no hdr chain               101        0 misc
mec0 TX pkts  w/ptrs  1 hdr chain            116410      110 misc
mec0 TX pkts  w/ptrs  2 hdr chains              415        0 misc
mec0 TX pkts  w/ptrs  ~8bytes hdr               104        0 misc
mec0 TX pkts  w/ptrs ~32bytes hdr             10001        9 misc
mec0 TX pkts  w/ptrs ~64bytes hdr             52465       49 misc
mec0 TX pkts  w/ptrs ~80bytes hdr             54148       51 misc
mec0 TX pkts  w/ptrs ~96bytes hdr               211        0 misc
mec0 TX stalled due to no txdesc               7470        7 misc
mec0 TX empty interrupts                       6869        6 misc
mec0 TX sent interrupts                        7498        7 misc