Thursday, December 11, 2008


Ubuntu Hardy HVM vs PV DomU at opensolaris 2008.11 Dom0


Start with install HVM on zvol (/dev/zvol/dsk/bigpool/disk3)








When done:-

# apt-get install build-essentials
# apt-get install linux-image-xen

Download ethtool-6 package and install it with intend to disable checksums offloading
on PV DomU with image on same zvol.
********************************************
Add one more entry to /boot/grub/menu.lst
********************************************

default 0
# hidemenu
timeout 10

title Ubuntu 8.04.1, kernel 2.6.24-22-xen
root (hd0,0)
kernel /boot/vmlinuz-2.6.24-22-xen root=UUID=d60fdbd1-29a5-452e-81b8-20af8423cb33 ro
initrd /boot/initrd.img-2.6.24-22-xen

title Ubuntu 8.04.1, kernel 2.6.24-19-generic
root (hd0,0)
kernel /boot/vmlinuz-2.6.24-19-generic root=UUID=d60fdbd1-29a5-452e-81b8-20af8423cb33 ro quiet splash
initrd /boot/initrd.img-2.6.24-19-generic
quiet
. . . . . .
:wq

Add a console on xvc0:

# sed -e ’s/tty1/xvc0/’ /etc/event.d/tty1 | tee /etc/event.d/xvc0

Shutdown HVM DomU.
Create Ubuntu PV DomU profile at Dom0, referencing same image file as Ubuntu HVM DomU:-

name = "UbuntuPV"
memory = 2048
disk = [ 'phy:/dev/zvol/dsk/bigpool/disk3,hda,w']
vif = [ ' ' ]

Start PV DomU:-

root@opensolaris:/export/home/vm# xm create -c ub8.py







Started domain UbuntuPV
[ 0.000000] Linux version 2.6.24-22-xen (buildd@crested) (gcc version 4.2.3 (Ubuntu 4.2.3-2ubuntu7)) #1 SMP Mon Nov 24 21:35:54 UTC 2008 (Ubuntu 2.6.24-4.6-generic)
[ 0.000000] Command line: root=UUID=0719122c-ad35-421e-a5bb-2781384d7fc0
[ 0.000000] BIOS-provided physical RAM map:
[ 0.000000] Xen: 0000000000000000 - 0000000080800000 (usable)
[ 0.000000] end_pfn_map = 526336
[ 9603.583251] Zone PFN ranges:
[ 9603.583252] DMA 0 -> 4096
[ 9603.583253] DMA32 4096 -> 1048576
[ 9603.583254] Normal 1048576 -> 1048576
[ 9603.583255] Movable zone start PFN for each node
[ 9603.583256] early_node_map[1] active PFN ranges
[ 9603.583257] 0: 0 -> 526336
[ 9603.611871] No mptable found.
[ 9603.615908] PERCPU: Allocating 22368 bytes of per cpu data
[ 9603.615925] Built 1 zonelists in Zone order, mobility grouping on. Total pages: 519140
[ 9603.615927] Kernel command line: root=UUID=0719122c-ad35-421e-a5bb-2781384d7fc0
[ 9603.616246] Initializing CPU#0
[ 9603.616406] PID hash table entries: 4096 (order: 12, 32768 bytes)
[ 9603.616440] Xen reported: 3005.552 MHz processor.
[ 0.153012] console [xvc0] enabled
[ 0.153041] Console: colour dummy device 80x25
[ 0.153632] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes)
[ 0.154072] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes)
[ 0.154201] Software IO TLB disabled
[ 0.167178] Memory: 2027452k/2105344k available (2532k kernel code, 69052k reserved, 1332k data, 220k init)
[ 0.233731] Calibrating delay using timer specific routine.. 6013.68 BogoMIPS (lpj=12027368)
[ 0.233764] Security Framework initialized
[ 0.233770] SELinux: Disabled at boot.
[ 0.233775] AppArmor: AppArmor initialized
[ 0.233778] Failure registering capabilities with primary security module.
[ 0.233788] Mount-cache hash table entries: 256
[ 0.233884] CPU: L1 I cache: 32K, L1 D cache: 32K
[ 0.233887] CPU: L2 cache: 6144K
[ 0.233893] CPU: Physical Processor ID: 0
[ 0.233894] CPU: Processor Core ID: 1
[ 0.233899] SMP alternatives: switching to UP code
[ 0.234513] Freeing SMP alternatives: 23k freed
[ 0.234593] Early unpacking initramfs... done
[ 0.247514] Brought up 1 CPUs
[ 0.247868] net_namespace: 120 bytes
[ 0.247871] failed to set up cpufreq notifier
[ 0.265754] Time: 165:165:165 Date: 165/165/65
[ 0.265774] NET: Registered protocol family 16
[ 0.277566] Brought up 1 CPUs
[ 0.277577] PCI: Fatal: No config space access function found
[ 0.277579] PCI: setting up Xen PCI frontend stub
[ 0.277943] ACPI: Interpreter disabled.
[ 0.277947] Linux Plug and Play Support v0.97 (c) Adam Belay
[ 0.277966] pnp: PnP ACPI: disabled
[ 0.278261] xen_mem: Initialising balloon driver.
[ 0.279111] Setting mem allocation to 2097152 kiB
[ 0.279279] PCI: System does not support PCI
[ 0.279282] PCI: System does not support PCI
[ 0.293390] NET: Registered protocol family 8
[ 0.293394] NET: Registered protocol family 20
[ 0.293447] AppArmor: AppArmor Filesystem Enabled
[ 0.293695] NET: Registered protocol family 2
[ 0.297369] Time: xen clocksource has been installed.
[ 0.329139] IP route cache hash table entries: 65536 (order: 7, 524288 bytes)
[ 0.329332] TCP established hash table entries: 262144 (order: 10, 4194304 bytes)
[ 0.330547] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[ 0.330911] TCP: Hash tables configured (established 262144 bind 65536)
[ 0.330913] TCP reno registered
[ 0.341195] checking if image is initramfs... it is
[ 0.357939] Freeing initrd memory: 23692k freed
[ 0.365241] audit: initializing netlink socket (disabled)
[ 0.365256] audit(1228988849.828:1): initialized
[ 0.365431] VFS: Disk quotas dquot_6.5.1
[ 0.365444] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[ 0.365494] io scheduler noop registered
[ 0.365496] io scheduler anticipatory registered
[ 0.365498] io scheduler deadline registered
[ 0.365502] io scheduler cfq registered (default)
[ 0.365635] Xen virtual console successfully installed as xvc0
[ 0.365665] Event-channel device installed.
[ 0.371631] Successfully initialized TPM backend driver.
[ 0.378447] netfront: Initialising virtual ethernet driver.
[ 0.379147] xen-vbd: registered block device major 3
[ 0.379160] blkfront: hda: barriers enabled
[ 0.379559] hda: hda1 hda2 < hda5 >
[ 0.394525] rtc: IRQ 8 is not free.
[ 0.394573] Linux agpgart interface v0.102
[ 0.394911] RAMDISK driver initialized: 16 RAM disks of 65536K size 1024 blocksize
[ 0.394953] input: Macintosh mouse button emulation as /devices/virtual/input/input0
[ 0.395021] PNP: No PS/2 controller found. Probing ports directly.
[ 0.395840] i8042.c: No controller found.
[ 0.397153] mice: PS/2 mouse device common for all mice
[ 0.397176] cpuidle: using governor ladder
[ 0.397221] NET: Registered protocol family 1
[ 0.397255] registered taskstats version 1
[ 0.496912] XENBUS: Device with no driver: device/console/0
[ 0.496933] Magic number: 1:252:3141
[ 0.497030] /build/buildd/linux-2.6.24/debian/build/custom-source-xen/drivers/rtc/hctosys.c: unable to open rtc device (rtc0)
[ 0.497042] Freeing unused kernel memory: 220k freed
Loading, please wait...
Begin: Loading essential drivers... ...
[ 0.718644] fuse init (API version 7.9)
[ 0.741243] thermal: Unknown symbol acpi_processor_set_thermal_limit
Done.
Begin: Running /scripts/init-premount ...
Done.
Begin: Mounting root file system... ...
Begin: Running /scripts/local-top ...
ata_id[1212]: main: HDIO_GET_IDENTITY failed for '/dev/.tmp-3-0'
Done.
Begin: Waiting for root file system... ...
Done.
Begin: Running /scripts/local-premount ...
Done.
[ 1.362433] kjournald starting. Commit interval 5 seconds
[ 1.362441] EXT3-fs: mounted filesystem with ordered data mode.
Begin: Running /scripts/local-bottom ...
Done.
Done.
Begin: Running /scripts/init-bottom ...
Done.
* Reading files needed to boot... [ OK ]
* Setting preliminary keymap... [ OK ]
* Preparing restricted drivers... [ OK ]
* Setting the system clock
Cannot access the Hardware Clock via any known method.
Use the --debug option to see the details of our search for an access method.
* Unable to set System Clock to: Thu Dec 11 09:47:31 UTC 2008
* Starting basic networking... [ OK ]
* Starting kernel event manager... [ OK ]
* Loading hardware drivers... ata_id[2237]: main: HDIO_GET_IDENTITY failed for '/dev/.tmp-3-0'
[ OK ]
* Setting the system clock
Cannot access the Hardware Clock via any known method.
Use the --debug option to see the details of our search for an access method.
* Unable to set System Clock to: Thu Dec 11 09:47:32 UTC 2008
* Loading kernel modules... * Loading manual drivers... [ 2.694121] lp: driver loaded but no devices found
[ OK ]
* Setting kernel variables... [ OK ]
* Activating swap... [ OK ]
* Checking root file system... fsck 1.40.8 (13-Mar-2008)
/dev/hda1: clean, 111149/942080 files, 650438/3755185 blocks
[ OK ]
* Checking file systems... fsck 1.40.8 (13-Mar-2008)
[ OK ]
* Mounting local filesystems... [ OK ]
* Activating swapfile swap... [ OK ]
$Mounting securityfs on /sys/kernel/security: done.
Loading AppArmor profiles : done.
* Checking minimum space in /tmp... [ OK ]
* Skipping firewall: ufw (not enabled)... [ OK ]
* Configuring network interfaces... [ OK ]
/dev/mem: mmap: Bad address
/dev/mem: mmap: Bad address
* Starting system log daemon... [ OK ]
* Doing Wacom setup... cat: */id: No such file or directory
[ OK ]
* Starting kernel log daemon... [ OK ]
* Starting system message bus dbus [ OK ]
* Starting network connection manager NetworkManager [ OK ]
* Starting network events dispatcher NetworkManagerDispatcher [ OK ]
* Starting System Tools Backends system-tools-backends [ OK ]
* Starting Avahi mDNS/DNS-SD Daemon avahi-daemon [ OK ]
* Starting Common Unix Printing System: cupsd [ OK ]
/dev/mem: mmap: Bad address
/dev/mem: mmap: Bad address
/dev/mem: mmap: Bad address
/dev/mem: mmap: Bad address
* Starting powernowd... * CPU frequency scaling not supported... [ OK ]
* Starting DHCP D-Bus daemon dhcdbd [ OK ]
* Starting Hardware abstraction layer hald [ OK ]
* Starting bluetooth [ OK ]
* Starting GNOME Display Manager... [ OK ]
* Starting anac(h)ronistic cron anacron [ OK ]
* Starting deferred execution scheduler atd [ OK ]
* Starting periodic command scheduler crond [ OK ]
* Checking battery state... /dev/mem: mmap: Bad address
/dev/mem: mmap: Bad address
/dev/mem: mmap: Bad address
/dev/mem: mmap: Bad address
[ OK ]
* Running local boot scripts (/etc/rc.local) [ OK ]

Ubuntu 8.04.1 boris-desktop xvc0

boris-desktop login: root
Password:
Linux boris-desktop 2.6.24-22-xen #1 SMP Mon Nov 24 21:35:54 UTC 2008 x86_64

The programs included with the Ubuntu system are free software;
the exact distribution terms for each program are described in the
individual files in /usr/share/doc/*/copyright.

Ubuntu comes with ABSOLUTELY NO WARRANTY, to the extent permitted by
applicable law.

To access official Ubuntu documentation, please visit:
http://help.ubuntu.com/
root@boris-desktop:~# ifconfig
eth0 Link encap:Ethernet HWaddr 00:16:3e:2c:8e:15
inet addr:192.168.1.63 Bcast:192.168.1.255 Mask:255.255.255.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:5 errors:0 dropped:0 overruns:0 frame:0
TX packets:26 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:1642 (1.6 KB) TX bytes:4552 (4.4 KB)

lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)

root@boris-desktop:~# /usr/local/sbin/ethtool -K eth0 tx off
root@boris-desktop:~# apt-get remove network-manager
Reading package lists... Done
Building dependency tree
Reading state information... Done
The following packages will be REMOVED:
network-manager network-manager-gnome
0 upgraded, 0 newly installed, 2 to remove and 185 not upgraded.
After this operation, 2626kB disk space will be freed.
Do you want to continue [Y/n]? Y
(Reading database ... 99473 files and directories currently installed.)
Removing network-manager-gnome ...
Removing network-manager ...
* Stopping network connection manager NetworkManager [ OK ]
* Stopping network events dispatcher NetworkManagerDispatcher [ OK ]
root@boris-desktop:~# cat /etc/network/interfaces
auto lo
iface lo inet loopback

root@boris-desktop:~# cat "auto eth0" >> /etc/network/interfaces
cat: auto eth0: No such file or directory
root@boris-desktop:~# echo "auto eth0" >> /etc/network/interfaces
root@boris-desktop:~# cat /etc/network/interfaces
auto lo
iface lo inet loopback

auto eth0
root@boris-desktop:~# echo "iface eth0 inet dhcp" >> /etc/network/interfaces
root@boris-desktop:~# cat /etc/network/interfaces
auto lo
iface lo inet loopback

auto eth0
iface eth0 inet dhcp
root@boris-desktop:~# /etc/init.d/networking restart
* Reconfiguring network interfaces... There is already a pid file /var/run/dhclient.eth0.pid with pid 0
Internet Systems Consortium DHCP Client V3.0.6
Copyright 2004-2007 Internet Systems Consortium.
All rights reserved.
For info, please visit http://www.isc.org/sw/dhcp/

Listening on LPF/eth0/00:16:3e:2c:8e:15
Sending on LPF/eth0/00:16:3e:2c:8e:15
Sending on Socket/fallback
DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 4
DHCPOFFER of 192.168.1.63 from 192.168.1.1
DHCPREQUEST of 192.168.1.63 on eth0 to 255.255.255.255 port 67
DHCPACK of 192.168.1.63 from 192.168.1.1
bound to 192.168.1.63 -- renewal in 122354 seconds.
[ OK ]
root@boris-desktop:~# ifconfig
eth0 Link encap:Ethernet HWaddr 00:16:3e:2c:8e:15
inet addr:192.168.1.63 Bcast:192.168.1.255 Mask:255.255.255.0
inet6 addr: fe80::216:3eff:fe2c:8e15/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:20 errors:0 dropped:0 overruns:0 frame:0
TX packets:25 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:2978 (2.9 KB) TX bytes:4453 (4.3 KB)

lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)

root@boris-desktop:~#

Add to /etc/rc.local :-

/usr/local/sbin/ethtool -K eth0 tx off

to disable checksum offloading at DomU (due to "rge" Solaris Driver at Dom0) and reboot.
Set up VNC at Ubuntu Hardy PV DOMU per [1]:-











Notice that install Ubuntu HVM and runtime performance at opensolaris 2008.11 Dom0
is extremely low versus same HVM perfomance at Xen 3.3.1 openSUSE 11.1 Dom0 on
the same box with C2D E8400 and 8 GB RAM.
Actually, Linux as well as Nevada HVM DomUs demonstrate very low performance even
been installed on zvols. Paravirtual DomUs behave at opensolaris 2008.11 absolutely
normal been installed on zvol's images.