WARNING - OLD ARCHIVES

This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
   
 
 
Xen 
 
Home Products Support Community News
 
   
 

xen-users

[Xen-users] Re: Memory squeeze in netback driver

To: xen-users@xxxxxxxxxxxxxxxxxxx
Subject: [Xen-users] Re: Memory squeeze in netback driver
From: "Scott Moe" <smoe868@xxxxxxxxx>
Date: Fri, 19 Jan 2007 06:53:33 -0500
Delivery-date: Fri, 19 Jan 2007 03:53:21 -0800
Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:to:subject:in-reply-to:mime-version:content-type:references; b=d0t3gfefhOtSucdGYSfqtdtB2C2dBmDSQxG4aYwuVPRs1gsfpJiY38Ji/oWK0wShJfyXkLuDCU1q/ZXUQSv88lR/uz3eEjwCJa9Lmkw6cNBut2/cNncdP0tILByRW2ooVxRA3p3NfKFiqqfQpBVSqujFbD9lsDXqAic1T3tufFk=
Envelope-to: www-data@xxxxxxxxxxxxxxxxxx
In-reply-to: <716de6bb0701120430s1724b891u3b32d38ab966434f@xxxxxxxxxxxxxx>
List-help: <mailto:xen-users-request@lists.xensource.com?subject=help>
List-id: Xen user discussion <xen-users.lists.xensource.com>
List-post: <mailto:xen-users@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/cgi-bin/mailman/listinfo/xen-users>, <mailto:xen-users-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/cgi-bin/mailman/listinfo/xen-users>, <mailto:xen-users-request@lists.xensource.com?subject=unsubscribe>
References: <716de6bb0701110723l1ead0cc0q44a0037eef7825ff@xxxxxxxxxxxxxx> <716de6bb0701120430s1724b891u3b32d38ab966434f@xxxxxxxxxxxxxx>
Sender: xen-users-bounces@xxxxxxxxxxxxxxxxxxx
7 day 20 hours and no error messages, no crashes, just solid as a rock.  Thanks again for all the guidance.

Scott Moe

On 1/12/07, Scott Moe < smoe868@xxxxxxxxx> wrote:
Before I had had no dom0_mem argument. With Xen 2 I had to specifiy the Dom0 memory size and I liked the idea of dynamically resizing with Xen 3.  Right now I've got both dom0_mem in grub/menu.list and dom0-min-mem in xend-config.sxp set to the same value. So far so good. I am at just over 20 hours of uptime with no memory squeeze error messages.

I would feel better about this fix if I understood the problem.  After what I have read about it in the last few days, now I am thinking it comes from the dynamic resizing of dom0 memory and not a memory leak in Xen networking.  If this is the case my config with dom0_mem == dom0-min-mem should eliminate the problem completely.

I'll reply again in a week and let you know what happens.

Thanks for the help,
Scott Moe

On 1/11/07, Scott Moe < smoe868@xxxxxxxxx> wrote:
I have had servers run Xen 2 without rebooting Dom0 for most of a year.

I am working now on a very similar machine with Xen 3.03 and Debian etch.

My network setup is slightly customized. I have 3 IP's and use network-route in xend-config.sxp. I specify vif-route as the vif script in the DomU config for 2 of my VM's.

I also create a bridge in /etc/network/interfaces. I have two other VM's that only interface to this bridge and the VM's with their own IP's have a second vif on the bridge. I specify the vif-bridge script in vif config for these interfaces.

Everything boots and runs great, for several hours. Yesterday, for example, the machine was rebooted in the morning. It ran for 11 hours without errors, then the kern.log started to fill up with this message:
xen-net: memory squeeze in netback driver
This went on for 13 hours at a rate of something like 5 to 10 messages per second. Then the log shows each vif on the bridge entering disabled state. The vif's with dedicated IP's were not mentioned in the log, but this morning only the dom0 ip was responsive. When I ssh into dom0 and try to ping the IP's routed to VM's I see no route to host. I looked at route and everything was listed correctly.

I hope someone has seen a similar problem and can give me some insite. My experience is limited but to me this smells like a memory leak. Perhaps there are updates that will fix this problem but have not made it into the Debian etch packages.

Thanks,
Scott Moe


_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-users