WARNING - OLD ARCHIVES

This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
   
 
 
Xen 
 
Home Products Support Community News
 
   
 

xen-users

[Xen-users] IO intensive guests - how to design for best performance

To: xen-users@xxxxxxxxxxxxxxxxxxx
Subject: [Xen-users] IO intensive guests - how to design for best performance
From: Kevin Maguire <k.c.f.maguire@xxxxxxxxx>
Date: Thu, 24 Jun 2010 14:03:06 +0200
Delivery-date: Thu, 24 Jun 2010 05:04:28 -0700
Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:received:date:message-id :subject:from:to:content-type; bh=Y/lhCbuDG7AB4yJ/FmlqPWf0XWnMpJv52IcbU1JqMRw=; b=LULZxDEGwCZBw2sXIjJMqpj4L3y+twoj2Ph3A8EFvDsDr1xV4sJxaoVSrKRRSFm170 jw+nc9Qb8/CEEs8AETwlRL8YYTvl351JTMZwOHG/HnWpWG43HCy9Gud+SIGeo30M5ts5 3+VwLBX7Yezjnzj3N0bXnFuH/kuROZkjFRAp4=
Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:date:message-id:subject:from:to:content-type; b=dHX6J23inE9rE/tsZyXAYeDGcOuHU4eAC/Dp+PMQyCjp2fnoMXe4hwO+4G36qchG9I Nap35UOA/0njPdwBK9FyGiHmi4fPeFlGDosbxT+zrvCTOXe2Tfjso+Li36eelDpPJNEQ /leqmCZW8Dxww2LsAeMmdBt63vFpOANeJyjsQ=
Envelope-to: www-data@xxxxxxxxxxxxxxxxxxx
List-help: <mailto:xen-users-request@lists.xensource.com?subject=help>
List-id: Xen user discussion <xen-users.lists.xensource.com>
List-post: <mailto:xen-users@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/mailman/listinfo/xen-users>, <mailto:xen-users-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/mailman/listinfo/xen-users>, <mailto:xen-users-request@lists.xensource.com?subject=unsubscribe>
Sender: xen-users-bounces@xxxxxxxxxxxxxxxxxxx
Hi

I am trying to engineer a HA xen solution for a specific application workload.

I will use:

*) 2 multicore systems (maybe 32 or 48 cores) with lots of RAM (256 GB)
*) dom0 OS will be RHEL 5.5
*) I would prefer to use xen as bundled by the distribution, but if
required features are found in later releases then this can be
considered
*) the servers are connected to the SAN
*) I have about 10 TB of shared storage, and will use around 20-25
RHEL paravirt guests
*) The HA I will manage with heartbeat, probably use use clvmd for the
shared storage


My concern is to get the most out of the system in terms of IO.  The
guests will have a range of vCPUs assigned, from 1 to 8 say, and their
workload varies over time. when they are doing some work it is both
I/O and CPU intensive. It is only in unlikely use cases that all or
most guests are very busy at the same time.

The current solution to this workload is a cluster of nodes with
either GFS (using shared SAN storage)  or local disks, of which both
approaches have some merits.  However I am not tied to that
architecture at all.

There seems a lot (too many!) of options here

*) created a large LUN / LVM volume on my SAN, and pass it to the
guests and use GFS/GFS2
*) same thing, except use OCFS2
*) split my SAN storage into man LUNs / LVM volumes, and export 1
chunk per VM via phys: or tap:... interfaces
*) more complex PCI-passthru configurations giving guest direct (?)
access to storage
*) create a big ext3/xfs/... file system on dom0 and export using NFS
to guests (a kind of loopback?)
*) others ...

I ask really for any advise and experiences of list members faced with
similar problems and what they found best.

Thanks
KM

_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-users

<Prev in Thread] Current Thread [Next in Thread>