Crash after crash of NetBSD/Xen system

[tg%gmplib.org@localhost (Torbjörn Granlund)]

A Xeon system which has run NetBSD/Xen since February 2014 has crashed
repeatedly in the last 10 days.

After the first 4 crashes, I on Dec 21 updated NetBSD to the current 7.0
sources.  I upgraded xen to the current ports xenkernel45 the day after.

Then, after about a week without any new crash, the system yesterday
crashed 3 times within an hour.

For the first crash, this was logged in /var/log/messages:

Dec 29 17:01:35 martin /netbsd: fatal page fault in supervisor mode
Dec 29 17:01:35 martin /netbsd: trap type 6 code 3 rip ffffffff80454d7f cs e030 rflags 10216 cr2 ffffa0005a08f80b ilevel 0 rsp ffffa0005a08b920
Dec 29 17:01:35 martin /netbsd: curlwp 0xffffa00003a164230, protocol x86_64-abi
Dec 29 17:01:35 martin /netbsd: tap8: detached
Dec 29 17:01:35 martin /netbsd: xbd backend domain 3 handin traceback...
Dec 29 17:01:35 martin /netbsd: vpanic() at netbsd:vpanic+0x13c
Dec 29 17:01:35 martin /netbsd: snprintf() at netbsd:snprintf
Dec 29 17:01:35 martin /netbsd: startlwp() at netbsd:startlwp
Dec 29 17:01:35 martin /netbsd: alltraps() at netbsd:alltraps+0x9f
Dec 29 17:01:35 martin /netbsd: pf_test_state_tcp() at netbsd:pf_test_state_tcp+0xf32
Dec 29 17:01:35 martin /netbsd: pf_test() at netbsd:pf_test+0xa42
Dec 29 17:01:35 martin /netbsd: pfil4_wrapper() at netbsdsconnecting
Dec 29 17:01:35 martin /netbsd: xbd backend: detach device wd1d for domain 1
Dec 29 17:01:35 martin /netbsd: xvif1i0c4
Dec 29 17:01:35 martin /netbsd: ip_output() at netbsd:ip_output+0x31c
Dec 29 17:01:35 martin /netbsd: ip_forward() at netbsd:ip_forward+0x164
Dec 29 17:01:35 martin /netbsd: ipintr() at netbsd:ipintr+0x9d7
Dec 29 17:01:35 martin /netbsd: softint_thread() at netbsd:softint_thread+0x5a
Dec 29 17:01:35 martin /netbsd: cpu0: End traceback...
Dec 29 17:01:35 martin /netbsd: 
Dec 29 17:01:35 martin /netbsd: dumping to dev 0,1 (offset=0, size=0): not possible
Dec 29 17:01:35 martin /netbsd: rebooting...
Dec 29 17:01:35 martin /netbsd: Copyright (c) 1996, 1997, 1998, 1999, 2000, 2001, 2002, 2003, 2004, 2005,

Some pre-update crashes logged similar "panics", while yet other crashes
log nothing of interest.

The hardware is a CPU E5-1650 v2 @
3.50GHz, 96 GiB ECC DRAM, 3 Samsung SV843/SM843 SSD disks, all on a
Supermicro motherboard in a Supermicro case.

This is either NetBSD problems or a hardware problems which has
developed.

This is a highly critical system.  Please help.  I need to get this
stable ASAP.


-- 
Torbjörn
Please encrypt, key id 0xC8601622