Re: prerequisites for our atf suite

[Paul Goyette <paul%whooppee.com@localhost>]

On Thu, 10 Nov 2011, Greg Troxel wrote:

> summary: I'm unclear on what state a machine should be in prior to
> running ATF.
>
> I have a -current tree with a not-yet-committed change, and I'd like to
> run the test suite.  So I built a full release to ISO, and in virtualbox
> used that iso to do an installation.
>
> I booted single user, remounted / rw, and did, more or less
>
> cd /usr/tests
> atf-run . | atf-report
>
> and found that lots of tests are failing (with signal 6).

I saw that recently on amd64 - it "went away" on its own.

> I then let the system come up multiuser, but with wm0 not configured
> (just lo0), and tried again.  There are still problems.
>
> What I don't understand is:
>
>  in order to run the full test suite, in what state should the system
>  be?  Is it supposed to work in any or all of the following:
>
>    single user, ro fs (enough mounted to have base system present)
>
>    single user, rw fs
>
>    multiuser, no Ethernets configured
>
>    multiuser, an Ethernet configured
>
>    multiuser, an Ethernet configured, various daemons running, e.g. a
>    system that's being used
>
>  Here, work means "test results match the results shown on the
>  autobuild/tests page".   So I would expect 2 failed tests, or
>  sometimes 1.

I think it needs to be in multi user, but does not require any network 
interfaces (except maybe lo0).  You will need comp, base, etc, text, and 
test sets for most things.  One or two tests actually depend on the 
games set!



-------------------------------------------------------------------------
| Paul Goyette     | PGP Key fingerprint:     | E-mail addresses:       |
| Customer Service | FA29 0E3B 35AF E8AE 6651 | paul at whooppee.com    |
| Network Engineer | 0786 F758 55DE 53BA 7731 | pgoyette at juniper.net |
| Kernel Developer |                          | pgoyette at netbsd.org  |
-------------------------------------------------------------------------