Re: Automated report: NetBSD-current/i386 test failure

[Andreas Gustafsson <gson%gson.org@localhost>]

This morning, the NetBSD Test Fixture wrote:
> The newly failing test case is:
> 
>     net/if_ipsec/t_ipsec_natt:ipsecif_natt_transport_rijndaelcbc
> 
> The above test failed in each of the last 3 test runs, and passed in
> at least 27 consecutive runs before that.
> 
> The following commits were made between the last successful test and
> the failed test:
> 
>     2020.03.04.22.00.03 ad src/sys/arch/x86/x86/pmap.c,v 1.362
>     2020.03.04.22.07.08 christos src/external/bsd/Makefile,v 1.68
>     2020.03.04.22.09.00 christos src/distrib/sets/lists/base/mi,v 1.1231
>     2020.03.04.22.09.00 christos src/distrib/sets/lists/debug/mi,v 1.296
>     2020.03.04.22.24.46 fcambus src/share/misc/inter.phone,v 1.32
>     2020.03.04.22.56.08 jmcneill src/external/bsd/Makefile,v 1.69

I'm not sure what happened here.  The ipsecif_natt_transport_null and
ipsecif_natt_transport_rijndaelcbc test cases both failed in the same
three consecutive tests which seems unlikely to be a coincidence, but
whatever it was, it appears to have been resolved as they have both
passed twice since then.

Here are the outcomes of the last 40 runs for the two test cases
with "-" meaning success and "X" meaning failure:

  --------XX-----X--------------X-X--XXX--   net/if_ipsec/t_ipsec_natt:ipsecif_natt_transport_null
  -----X-----------------------------XXX--   net/if_ipsec/t_ipsec_natt:ipsecif_natt_transport_rijndaelcbc

-- 
Andreas Gustafsson, gson%gson.org@localhost