WARNING - OLD ARCHIVES

This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
   
 
 
Xen 
 
Home Products Support Community News
 
   
 

xen-users

RE: [Xen-users] xen 3.3 -> tap:aio performance over nfs

To: "C V" <rayvittal-lists@xxxxxxxxx>, <xen-users@xxxxxxxxxxxxxxxxxxx>
Subject: RE: [Xen-users] xen 3.3 -> tap:aio performance over nfs
From: "James Harper" <james.harper@xxxxxxxxxxxxxxxx>
Date: Sat, 31 Jan 2009 13:34:49 +1100
Cc:
Delivery-date: Fri, 30 Jan 2009 18:35:45 -0800
Envelope-to: www-data@xxxxxxxxxxxxxxxxxxx
In-reply-to: <197060.7633.qm@xxxxxxxxxxxxxxxxxxxxxxxxxxx>
List-help: <mailto:xen-users-request@lists.xensource.com?subject=help>
List-id: Xen user discussion <xen-users.lists.xensource.com>
List-post: <mailto:xen-users@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/mailman/listinfo/xen-users>, <mailto:xen-users-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/mailman/listinfo/xen-users>, <mailto:xen-users-request@lists.xensource.com?subject=unsubscribe>
References: <197060.7633.qm@xxxxxxxxxxxxxxxxxxxxxxxxxxx>
Sender: xen-users-bounces@xxxxxxxxxxxxxxxxxxx
Thread-index: AcmDSHnchocDZNdERRu2cx1YQuvW+QAA5DlA
Thread-topic: [Xen-users] xen 3.3 -> tap:aio performance over nfs
> 
> I've been getting disappointing performance for file-backed disks
mounted
> using tap:aio over an NFS mount.
> For example, bonnie++ reports 3 MB/s for block writes in the domU to
> that
> disk, but in dom0, bonnie++ reports 38 MB/s for that same mount. The
> same domU can get 40 MB/s to the same filer using a phy: block device
> over iSCSI .
> 
> It seems that
> 1. tap:aio causes synchronous writes to the nfs mount (6 writes, wait
for
> ack, write 6 more etc) as opposed to NFSv3 async write
> 2. Each synchronous write writes very small blocks (4K bytes vs max of
32K
> bytes)
> 
> Is there any configuration option to tweak this behavior to get
better-
> performing async writes to the filer?
> 

I am assuming here that you have two physical servers, one with your
file-backed disk images on it, and a second which runs Xen and accesses
those files over NFS. If I got that the wrong way around then ignore the
rest of this email :)

I think that using tap:aio over NFS is not the correct solution to the
problem. I can think of a whole load of ways it could go wrong...

You might like to try file: but you would be sacrificing performance for
integrity.

But I think the correct way to do it would be to use iSCSI or AoE. Using
vblade you could set up AoE very very quickly and do some testing,
assuming that you are on the same broadcast segment (AoE can't cross a
router).

James


_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-users