Subject: Re: PCTS run on NetBSD.
To: None <tech-userlevel@netbsd.org>
From: Matt Thomas <matt@3am-software.com>
List: tech-userlevel
Date: 06/05/2003 09:53:09
At 11:36 PM 6/2/2003, I wrote:
>After fixing a bug in make which the Open Group POSIX Conformance
>Test Suite illuminated and banging on it to be happy with NetBSD,
>I've done a preliminary run on NetSD 1.6R.  Some of my configuration
>needs to change to eliminate some Unsupported errors but even so the
>results are interesting.
>
>The expanded result is at
>ftp://ftp.netsd.org/pub/incoming/matt/PCSTS.results
>
>BTW, having localedef instead of mklocale would be really nice.

Opps, as noted in a previous message, that should have been:
ftp://ftp.netsd.org/pub/incoming/matt/PCTS.results  However that file now
contains the latest test results; the previous results are available in
ftp://ftp.netsd.org/pub/incoming/matt/PCTS.results.old

Running these tests is still a learning process for me.  A summary of
previous test run (PCTS.results.old) is:

             |    TOTALS   Succeeded   Warnings Unresolved Unsupported 
NotInUse|
Section     | Expect Actual       Failed      FIP    Uninitiated  Untested    |
____________|_________________________________________________________________|
             | 
|
ANSI.hdr    |   386    386    171    11    0    2     0     0   201    0    1 |
ANSI.os   F |  1244   1244    868    10    0    0   106    69     1    1  189 |
ANSI.os   M |  1244   1244     62     0    0    0    30     0     0    0 1152 |
POSIX.hdr   |   394    394    175    37    0    2     0     0   173    0    7 |
POSIX.os  F |  1600   1600    395    17    1    1    76  1057    22    0   31 |
POSIX.os  M |  1600   1600      2     0    0    0     0     0     0    0 1598 |
TOTAL       |  6468   6468   1673    75    1    5   212  1126   397    1 2978 |
____________|_________________________________________________________________|

After tweaking the configuration a bit and setting up the environment so
that more tests move from the unresolved state, NetBSD has more failures
and shown in the summary of the latest test run (PCTS.results):

             |    TOTALS   Succeeded   Warnings Unresolved Unsupported 
NotInUse|
Section     | Expect Actual       Failed      FIP    Uninitiated  Untested    |
____________|_________________________________________________________________|
             | 
|
ANSI.hdr    |   386    386    171    11    0    2     0     0   201    0    1 |
ANSI.os   F |  1244   1244    935    50    1    0    52     1     1    4  200 |
ANSI.os   M |  1244   1244     65    12    0    0    15     0     0    0 1152 |
POSIX.hdr   |   394    394    180    33    0    2     0     0   172    0    7 |
POSIX.os  F |  1600   1598   1079    78    1    2   102    82    70    4  180 |
POSIX.os  M |  1600   1600      2     0    0    0     0     0     0    0 1598 |
TOTAL       |  6468   6466   2432   184    2    6   169    83   444    8 3138 |
____________|_________________________________________________________________|




-- 
Matt Thomas               Internet:   matt@3am-software.com
3am Software Foundry      WWW URL:    http://www.3am-software.com/bio/matt/
Cupertino, CA             Disclaimer: I avow all knowledge of this message