Cannot start a Linux domU: "Device 768 (vbd) could not be connected"

To: port-xen%NetBSD.org@localhost
Subject: Cannot start a Linux domU: "Device 768 (vbd) could not be connected"
From: Stephane Bortzmeyer <stephane%sources.org@localhost>
Date: Tue, 9 Jun 2009 21:51:21 +0200
I have a NetBSD dom0 "NetBSD 5.0 (XEN3_DOM0)". It boots and xend
starts.

But I cannot start a Linux domU. The default Debian/Linux kernel is
not accepted:

'Invalid kernel', 'xc_dom_compat_check: guest type xen-3.0-x86_32p not
supported by xen kernel

Googling finds pages explaining that 'p' in "xen-3.0-x86_32p" is for
PAE and that a NetBSD dom0 does not support PAE :-(

All the binary Linux kernels I can find are compiled for
PAE. <http://www.netbsd.org/ports/xen/howto.html#linux-domU> says
"using one of the vmlinuz-*-xenU kernels available in the Xen binary
distribution" But I do not find such distribution, I only have
<http://www.xen.org/download/> which distributes patched Linux
sources. So I compile a Linux kernel without PAE (not easy because the
Kconfig forces the use of PAE) but it does not boot:

% sudo xm create -c /usr/pkg/etc/xen/oroshi.cfg
Using config file "/usr/pkg/etc/xen/oroshi.cfg".
Error: Device 768 (vbd) could not be connected. Hotplug scripts not working.
             
This time, I find nothing on the Web (for a Linux dom0, it seems this
error message indicates a lack of loop devices).
  
Here is oroshi.cfg:

kernel = "/usr/local/lib/xen-kernels/xensource-vmlinuz-2.6.18-xen"
memory = 64
name = "oroshi"
disk = ['phy:/dev/wd0k,0x300,w', 'phy:/dev/wd0l,0x301,w']
root = "/dev/hda0 ro"
#extra = "xencons=tty1"

Here is the xend log:

[2009-06-09 21:46:16 96] DEBUG (XendDomainInfo:84) XendDomainInfo.create(['vm', 
['name', 'oroshi'], [
'memory', 64], ['vcpus', 1], ['on_xend_start', 'ignore'], ['on_xend_stop', 
'ignore'], ['image', ['lin
ux', ['kernel', '/usr/local/lib/xen-kernels/xensource-vmlinuz-2.6.18-xen'], 
['root', '/dev/hda0 ro']]
], ['device', ['vbd', ['uname', 'phy:/dev/wd0k'], ['dev', '0x300'], ['mode', 
'w']]], ['device', ['vbd
', ['uname', 'phy:/dev/wd0l'], ['dev', '0x301'], ['mode', 'w']]]])
[2009-06-09 21:46:16 96] DEBUG (XendDomainInfo:1520) 
XendDomainInfo.constructDomain
[2009-06-09 21:46:16 96] DEBUG (balloon:115) Balloon: 134160 KiB free; need 
2048; done.
[2009-06-09 21:46:16 96] DEBUG (XendDomain:434) Adding Domain: 4
[2009-06-09 21:46:16 96] DEBUG (XendDomainInfo:1580) XendDomainInfo.initDomain: 
4 256
[2009-06-09 21:46:16 96] DEBUG (XendDomainInfo:1614) 
_initDomain:shadow_memory=0x0, memory_static_max
=0x4000000, memory_static_min=0x0.
[2009-06-09 21:46:16 96] DEBUG (balloon:115) Balloon: 134160 KiB free; need 
65536; done.
[2009-06-09 21:46:17 96] INFO (image:128) buildDomain os=linux dom=4 vcpus=1
[2009-06-09 21:46:17 96] DEBUG (image:203) domid          = 4
[2009-06-09 21:46:17 96] DEBUG (image:204) memsize        = 64
[2009-06-09 21:46:17 96] DEBUG (image:205) image          = 
/usr/local/lib/xen-kernels/xensource-vmli
nuz-2.6.18-xen
[2009-06-09 21:46:17 96] DEBUG (image:206) store_evtchn   = 1
[2009-06-09 21:46:17 96] DEBUG (image:207) console_evtchn = 2
[2009-06-09 21:46:17 96] DEBUG (image:208) cmdline        = root=/dev/hda0 ro 
[2009-06-09 21:46:17 96] DEBUG (image:209) ramdisk        = 
[2009-06-09 21:46:17 96] DEBUG (image:210) vcpus          = 1
[2009-06-09 21:46:17 96] DEBUG (image:211) features       = 
[2009-06-09 21:46:17 96] INFO (XendDomainInfo:1422) createDevice: vbd : 
{'uuid': '6a79b5cc-80fe-b9eb-
0c70-c91b20e1fd57', 'bootable': 1, 'driver': 'paravirtualised', 'dev': '0x300', 
'uname': 'phy:/dev/wd
0k', 'mode': 'w'}
[2009-06-09 21:46:17 96] DEBUG (DevController:118) DevController: writing 
{'virtual-device': '768', '
device-type': 'disk', 'protocol': 'x86_32-abi', 'backend-id': '0', 'state': 
'1', 'backend': '/local/d
omain/0/backend/vbd/4/768'} to /local/domain/4/device/vbd/768.
[2009-06-09 21:46:17 96] DEBUG (DevController:120) DevController: writing 
{'domain': 'oroshi', 'front
end': '/local/domain/4/device/vbd/768', 'uuid': 
'6a79b5cc-80fe-b9eb-0c70-c91b20e1fd57', 'dev': '0x300
', 'state': '1', 'params': '/dev/wd0k', 'mode': 'w', 'online': '1', 
'frontend-id': '4', 'type': 'phy'
} to /local/domain/0/backend/vbd/4/768.
[2009-06-09 21:46:17 96] INFO (XendDomainInfo:1422) createDevice: vbd : 
{'uuid': 'df662476-3b33-d9f5-
344c-a41a66bed989', 'bootable': 0, 'driver': 'paravirtualised', 'dev': '0x301', 
'uname': 'phy:/dev/wd
0l', 'mode': 'w'}
[2009-06-09 21:46:17 96] DEBUG (DevController:118) DevController: writing 
{'virtual-device': '769', '
device-type': 'disk', 'protocol': 'x86_32-abi', 'backend-id': '0', 'state': 
'1', 'backend': '/local/d
omain/0/backend/vbd/4/769'} to /local/domain/4/device/vbd/769.
[2009-06-09 21:46:17 96] DEBUG (DevController:120) DevController: writing 
{'domain': 'oroshi', 'front
end': '/local/domain/4/device/vbd/769', 'uuid': 
'df662476-3b33-d9f5-344c-a41a66bed989', 'dev': '0x301
', 'state': '1', 'params': '/dev/wd0l', 'mode': 'w', 'online': '1', 
'frontend-id': '4', 'type': 'phy'
} to /local/domain/0/backend/vbd/4/769.
[2009-06-09 21:46:17 96] DEBUG (XendDomainInfo:2093) Storing VM details: 
{'on_xend_stop': 'ignore', '
shadow_memory': '0', 'uuid': '588b73db-304d-056b-cb25-35cec79a690c', 
'on_reboot': 'restart', 'start_t
ime': '1244576777.72', 'on_poweroff': 'destroy', 'on_xend_start': 'ignore', 
'on_crash': 'restart', 'x
end/restart_count': '0', 'vcpus': '1', 'vcpu_avail': '1', 'image': "(linux 
(kernel /usr/local/lib/xen
-kernels/xensource-vmlinuz-2.6.18-xen) (args 'root=/dev/hda0 ro ') (notes 
(HV_START_LOW 4118806528) (
FEATURES 
'writable_page_tables|writable_descriptor_tables|auto_translated_physmap|pae_pgdir_above_4gb
|supervisor_mode_kernel') (VIRT_BASE 3221225472) (GUEST_VERSION 2.6) 
(PADDR_OFFSET 3221225472) (GUEST
_OS linux) (HYPERCALL_PAGE 3222278144) (LOADER generic) (SUSPEND_CANCEL 1) 
(PAE_MODE no) (ENTRY 32222
74048) (XEN_VERSION xen-3.0)))", 'name': 'oroshi'}
[2009-06-09 21:46:17 96] DEBUG (XendDomainInfo:914) Storing domain details: 
{'console/ring-ref': '348
00', 'image/entry': '3222274048', 'console/port': '2', 'store/ring-ref': 
'34801', 'image/loader': 'ge
neric', 'vm': '/vm/588b73db-304d-056b-cb25-35cec79a690c', 
'control/platform-feature-multiprocessor-su
spend': '1', 'image/hv-start-low': '4118806528', 'image/guest-os': 'linux', 
'image/features/writable-
descriptor-tables': '1', 'image/virt-base': '3221225472', 'memory/target': 
'65536', 'image/guest-vers
ion': '2.6', 'image/features/supervisor-mode-kernel': '1', 'image/pae-mode': 
'no', 'console/limit': '
1048576', 'image/paddr-offset': '3221225472', 'image/hypercall-page': 
'3222278144', 'image/suspend-ca
ncel': '1', 'cpu/0/availability': 'online', 
'image/features/pae-pgdir-above-4gb': '1', 'image/feature
s/writable-page-tables': '1', 'image/features/auto-translated-physmap': '1', 
'name': 'oroshi', 'domid
[2009-06-09 21:46:17 96] DEBUG (DevController:120) DevController: writing 
{'domain': 'oroshi', 'front
end': '/local/domain/4/device/vbd/769', 'uuid': 
'df662476-3b33-d9f5-344c-a41a66bed989', 'dev': '0x301
', 'state': '1', 'params': '/dev/wd0l', 'mode': 'w', 'online': '1', 
'frontend-id': '4', 'type': 'phy'
} to /local/domain/0/backend/vbd/4/769.
[2009-06-09 21:46:17 96] DEBUG (XendDomainInfo:2093) Storing VM details: 
{'on_xend_stop': 'ignore', '
shadow_memory': '0', 'uuid': '588b73db-304d-056b-cb25-35cec79a690c', 
'on_reboot': 'restart', 'start_t
ime': '1244576777.72', 'on_poweroff': 'destroy', 'on_xend_start': 'ignore', 
'on_crash': 'restart', 'x
end/restart_count': '0', 'vcpus': '1', 'vcpu_avail': '1', 'image': "(linux 
(kernel /usr/local/lib/xen
-kernels/xensource-vmlinuz-2.6.18-xen) (args 'root=/dev/hda0 ro ') (notes 
(HV_START_LOW 4118806528) (
FEATURES 
'writable_page_tables|writable_descriptor_tables|auto_translated_physmap|pae_pgdir_above_4gb
|supervisor_mode_kernel') (VIRT_BASE 3221225472) (GUEST_VERSION 2.6) 
(PADDR_OFFSET 3221225472) (GUEST
_OS linux) (HYPERCALL_PAGE 3222278144) (LOADER generic) (SUSPEND_CANCEL 1) 
(PAE_MODE no) (ENTRY 32222
74048) (XEN_VERSION xen-3.0)))", 'name': 'oroshi'}
[2009-06-09 21:46:17 96] DEBUG (XendDomainInfo:914) Storing domain details: 
{'console/ring-ref': '348
00', 'image/entry': '3222274048', 'console/port': '2', 'store/ring-ref': 
'34801', 'image/loader': 'ge
neric', 'vm': '/vm/588b73db-304d-056b-cb25-35cec79a690c', 
'control/platform-feature-multiprocessor-su
spend': '1', 'image/hv-start-low': '4118806528', 'image/guest-os': 'linux', 
'image/features/writable-
descriptor-tables': '1', 'image/virt-base': '3221225472', 'memory/target': 
'65536', 'image/guest-vers
ion': '2.6', 'image/features/supervisor-mode-kernel': '1', 'image/pae-mode': 
'no', 'console/limit': '
1048576', 'image/paddr-offset': '3221225472', 'image/hypercall-page': 
'3222278144', 'image/suspend-ca
ncel': '1', 'cpu/0/availability': 'online', 
'image/features/pae-pgdir-above-4gb': '1', 'image/feature
s/writable-page-tables': '1', 'image/features/auto-translated-physmap': '1', 
'name': 'oroshi', 'domid
': '4', 'image/xen-version': 'xen-3.0', 'store/port': '1'}
[2009-06-09 21:46:17 96] DEBUG (DevController:118) DevController: writing 
{'protocol': 'x86_32-abi', 
'state': '1', 'backend-id': '0', 'backend': 
'/local/domain/0/backend/console/4/0'} to /local/domain/4
/device/console/0.
[2009-06-09 21:46:17 96] DEBUG (DevController:120) DevController: writing 
{'domain': 'oroshi', 'front
end': '/local/domain/4/device/console/0', 'uuid': 
'34b8e4a3-5db9-cf12-0656-81e435e77e32', 'frontend-i
d': '4', 'state': '1', 'location': '2', 'online': '1', 'protocol': 'vt100'} to 
/local/domain/0/backen
d/console/4/0.
[2009-06-09 21:46:17 96] DEBUG (XendDomainInfo:998) 
XendDomainInfo.handleShutdownWatch
[2009-06-09 21:46:18 96] DEBUG (DevController:151) Waiting for devices vif.
[2009-06-09 21:46:18 96] DEBUG (DevController:151) Waiting for devices usb.
[2009-06-09 21:46:18 96] DEBUG (DevController:151) Waiting for devices vbd.
[2009-06-09 21:46:18 96] DEBUG (DevController:156) Waiting for 768.
[2009-06-09 21:46:18 96] DEBUG (DevController:590) hotplugStatusCallback 
/local/domain/0/backend/vbd/
4/768/hotplug-status.
[2009-06-09 21:47:58 96] DEBUG (XendDomainInfo:1779) XendDomainInfo.destroy: 
domid=4
[2009-06-09 21:47:58 96] DEBUG (XendDomainInfo:1798) 
XendDomainInfo.destroyDomain(4)
[2009-06-09 21:47:58 96] DEBUG (XendDomainInfo:1444) Removing vbd/768
[2009-06-09 21:47:58 96] DEBUG (XendDomainInfo:574) 
XendDomainInfo.destroyDevice: deviceClass = vbd, 
device = vbd/768
[2009-06-09 21:47:58 96] DEBUG (XendDomainInfo:1444) Removing vbd/769
[2009-06-09 21:47:58 96] DEBUG (XendDomainInfo:574) 
XendDomainInfo.destroyDevice: deviceClass = vbd, 
device = vbd/769
[2009-06-09 21:47:58 96] DEBUG (XendDomainInfo:1444) Removing console/0
[2009-06-09 21:47:58 96] DEBUG (XendDomainInfo:574) 
XendDomainInfo.destroyDevice: deviceClass = conso
le, device = console/0
Follow-Ups:
- Re: Cannot start a Linux domU: "Device 768 (vbd) could not be connected"
  - From: Manuel Bouyer
Prev by Date: Re: "Hotplug scripts not working" again
Next by Date: Re: Cannot start a Linux domU: "Device 768 (vbd) could not be connected"
Previous by Thread: "Hotplug scripts not working" again
Next by Thread: Re: Cannot start a Linux domU: "Device 768 (vbd) could not be connected"
Indexes:
Home | Main Index | Thread Index | Old Index