[Xen-users] e1000e NIC and MTU issues

To:	xen-users@xxxxxxxxxxxxxxxxxxx
Subject:	[Xen-users] e1000e NIC and MTU issues
From:	Graeme Smith <graemes78@xxxxxxxxx>
Date:	Mon, 27 Apr 2009 11:15:21 -0700
Delivery-date:	Mon, 27 Apr 2009 11:16:17 -0700
Dkim-signature:	v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:date:message-id:subject :from:to:content-type; bh=P8R/9d3fU3uUhIh1qx/hkvtEDw7PDb9X97IagwTo2SE=; b=vMW3CW7h7BmHUQnKetvTyjiwkkoCXMeMoNifBzH5CfLqhIV7sgLbFvqKONmb0hWUmG ydb01zumw0JiMVCQ9nTWl7aisbTXgsWdej8Y7ibkAZ9Utg1p+VPPJXRDzbd3Bfu9nVfl uVTRWW+TFHvKI8icNwm5p6pE7RKKal2dgIJ7c=
Domainkey-signature:	a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:date:message-id:subject:from:to:content-type; b=ePhs+vb5jYbECzG0QDR5lAVdtWfFyM4FCk4DGacRFpNz0gUd/r/95J8h+yBrpLfsyJ GoQy2M2B8NmJEp2MVV7fQaycnYI2JQZLrqMpKMZtMPFZKamMtWo6rRYu+/+53yQbHGRN zN72SaySc11g1FJraKGErledmUCimeh2rAEfw=
Envelope-to:	www-data@xxxxxxxxxxxxxxxxxxx
List-help:	<mailto:xen-users-request@lists.xensource.com?subject=help>
List-id:	Xen user discussion <xen-users.lists.xensource.com>
List-post:	<mailto:xen-users@lists.xensource.com>
List-subscribe:	<http://lists.xensource.com/mailman/listinfo/xen-users>, <mailto:xen-users-request@lists.xensource.com?subject=subscribe>
List-unsubscribe:	<http://lists.xensource.com/mailman/listinfo/xen-users>, <mailto:xen-users-request@lists.xensource.com?subject=unsubscribe>
Sender:	xen-users-bounces@xxxxxxxxxxxxxxxxxxx

Hello,
I am observing a performance degradation (of about 100 Mbps dropl) between two domUs on different hosts when I set the MTU on dom0 to anything > 1500. The domUs are still configured with MTU of 1500, so effectively there isn't any traffic with bigger MTU ever generated. And the network is jumbo frame capable.

Furthermore, when I check the interrupts/second for dom0 using 'mpstat' command while a throughput test is on, I observe this rate to have increased (from 6000 intrs/sec to 9000 intrs/sec) as soon as I change the dom0 MTU from <=1500 to >= 1501 (I have tried 1501 and 9000). I also observe this degradation only when changing the MTU on dom0 hosting the receiver domU (in a netperf test).

The physical NIC on the host is Intel e100e, and the and platform is RedHat 5.2, Xen version 2.6.18-92.el5xen. It looks to me that this is an issue with the interrupt coalescing behavior of the NIC, and its interactions with Xen networking. Is the behavior of e1000e to different MTU settings well-known ?

However, when I do the throughput measurement between the hosts (dom0s and not domUs), I do not see any degradation with MTUs >= 1501.

Any ideas?
GS

_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-users

WARNING - OLD ARCHIVES

xen-users

[Xen-users] e1000e NIC and MTU issues