WARNING - OLD ARCHIVES

This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
   
 
 
Xen 
 
Home Products Support Community News
 
   
 

xen-users

Re: [Xen-users] Xen and networking.

To: "Stephan Seitz" <s.seitz@xxxxxxxxxxxx>
Subject: Re: [Xen-users] Xen and networking.
From: tmac <tmacmd@xxxxxxxxx>
Date: Fri, 28 Dec 2007 20:10:55 -0500
Cc: xen-users@xxxxxxxxxxxxxxxxxxx
Delivery-date: Fri, 28 Dec 2007 17:11:27 -0800
Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; bh=d1d3tCHzowETKLmVAL2LIHL1mShWXU1fnJ5nHT8WFy8=; b=xeOSHkmuTmdHycWlV0Bg9dshXiFdt+j+jxoU5AAJF3CoGJC2T6QVGmJ+QOjhiT8e7lmZNOj6tPd2MW8ds/UXYbiDR0NVDyPZELbSJiA+EVmuG143xtK4wKggUrwtwIoORaS3pP6HFoQD4V2QdrvxBQcxEvf1NUVUrGIh0LVCR30=
Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=ostqRznior2FrCqw3Nc2ywyeOz6HVF3fmgVwqkSAAVtLLYxAwLf/eRmVeKXwfcsu1mrn9cJUi4KhrQUReLTKNLypUuiRJHuRT3cJki+QTxXo+KvP+q9H13d35EK9LdyRIs2SU+x9+yE97E/C93DWGH7FitKqTCqWwskUa5FeUi4=
Envelope-to: www-data@xxxxxxxxxxxxxxxxxx
In-reply-to: <47759508.5090100@xxxxxxxxxxxx>
List-help: <mailto:xen-users-request@lists.xensource.com?subject=help>
List-id: Xen user discussion <xen-users.lists.xensource.com>
List-post: <mailto:xen-users@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/cgi-bin/mailman/listinfo/xen-users>, <mailto:xen-users-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/cgi-bin/mailman/listinfo/xen-users>, <mailto:xen-users-request@lists.xensource.com?subject=unsubscribe>
References: <73699aa30712281228j694f9fb5l17860901fad8cd77@xxxxxxxxxxxxxx> <47759508.5090100@xxxxxxxxxxxx>
Sender: xen-users-bounces@xxxxxxxxxxxxxxxxxxx
NetApp GX with two heads and 10GigE's.
Measured at over 2Gigabytes/sec!
Should easily handle 200MBytes/sec

Network path:

VirtHostA -GigE-> 4948-10G (port 1 )-10gigE-> 6509 -> -10GigE-> NetApp
VirtHostB -GigE-> 4948-10G (port 17)-10gigE-> 6509 -> -10GigE-> NetApp

On Dec 28, 2007 7:30 PM, Stephan Seitz <s.seitz@xxxxxxxxxxxx> wrote:
> Don't get me wrong,
>
> but my first thought was: What is the maximum expected throughput of the
> nfs server? It should at least be connected with 2 GBit/s to the switch,
> to serve two dd's with each ~100MB/s.
>
> Well, I assume both domU's are using the same nfs server.
>
>
> Regards,
>
> Stephan
>
>
> tmac schrieb:
>
> > I have a beefy machine
> > (Intel dual-quad core, 16GB memory 2 x GigE)
> >
> > I have loaded RHEL5.1-xen on the hardware and have created two logical 
> > systems:
> > 4 cpus, 7.5 GB memory 1 x Gige
> >
> > Following RHEL guidelines, I have it set up so that eth0->xenbr0 and
> > eth1->xenbr1
> > Each of the two RHEL5.1 guests uses one of the interfaces and this is
> > verified at the
> > switch by seeing the unique MAC addresses.
> >
> > If I do a crude test from one guest over nfs,
> > dd if=/dev/zero of=/nfs/test bs=32768 count=32768
> >
> > This yields almost always 95-100MB/sec
> >
> > When I run two simultaneously, I cannot seem to get above 25MB/sec from 
> > each.
> > It starts off with a large burst like each can do 100MB/sec, but then
> > in a couple
> > of seconds, tapers off to the 15-40MB/sec until the dd finishes.
> >
> > Things I have tried (installed on the host and the guests)
> >
> >  net.core.rmem_max = 16777216
> >  net.core.wmem_max = 16777216
> >  net.ipv4.tcp_rmem = 4096 87380 16777216
> >  net.ipv4.tcp_wmem = 4096 65536 16777216
> >
> >  net.ipv4.tcp_no_metrics_save = 1
> >  net.ipv4.tcp_moderate_rcvbuf = 1
> >  # recommended to increase this for 1000 BT or higher
> >  net.core.netdev_max_backlog = 2500
> >  sysctl -w net.ipv4.tcp_congestion_control=cubic
> >
> > Any ideas?
> >
> >
>
>
> --
> Stephan Seitz
> Senior System Administrator
>
> *netz-haut* e.K.
> multimediale kommunikation
>
> zweierweg 22
> 97074 würzburg
>
> fon: +49 931 2876247
> fax: +49 931 2876248
>
> web: www.netz-haut.de <http://www.netz-haut.de/>
>
> registriergericht: amtsgericht würzburg, hra 5054
>



-- 
--tmac

RedHat Certified Engineer #804006984323821 (RHEL4)
RedHat Certified Engineer #805007643429572 (RHEL5)

Principal Consultant, RABA Technologies

_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-users

<Prev in Thread] Current Thread [Next in Thread>