This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
Home Products Support Community News


Re: [Xen-API] Trying to gather statistics by parsing the rrd data files

To: Jonathan Ludlam <Jonathan.Ludlam@xxxxxxxxxxxxx>
Subject: Re: [Xen-API] Trying to gather statistics by parsing the rrd data files
From: Abhishek Joshi <abhishek@xxxxxxxxx>
Date: Wed, 23 Jun 2010 10:01:22 -0700
Cc: Kevin Kluge <kevin@xxxxxxxxx>, "xen-api@xxxxxxxxxxxxxxxxxxx" <xen-api@xxxxxxxxxxxxxxxxxxx>
Delivery-date: Wed, 23 Jun 2010 10:01:37 -0700
Envelope-to: www-data@xxxxxxxxxxxxxxxxxxx
In-reply-to: <AC0B0B90-478D-492C-980D-D2ECECE2B427@xxxxxxxxxxxxx>
List-help: <mailto:xen-api-request@lists.xensource.com?subject=help>
List-id: Discussion of API issues surrounding Xen <xen-api.lists.xensource.com>
List-post: <mailto:xen-api@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/mailman/listinfo/xen-api>, <mailto:xen-api-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/mailman/listinfo/xen-api>, <mailto:xen-api-request@lists.xensource.com?subject=unsubscribe>
References: <4C216546.6000100@xxxxxxxxx> <AC0B0B90-478D-492C-980D-D2ECECE2B427@xxxxxxxxxxxxx>
Sender: xen-api-bounces@xxxxxxxxxxxxxxxxxxx
User-agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv: Gecko/20100423 Thunderbird/3.0.4
Hi Jon,

Thanks for the link. I think I am doing something very similar to this. I have a python plugin written, which gets rrd updates on my localhost. I read the updates, and then parse them in Java.

However, for some of the calls to retrieve these rrd updates, my read times out. I am unable to figure out as to why this happens for only some cases (i.e. this happens only for some hosts I gather stats on). Perhaps this has got to do something with the load on that host?

Also, as I said, some of the rrd files are substantially larger than the others on the respective hosts. Is there any way to limit the size of the file one reads, so that the read from the plugin never times out? More specifically, is the read timeout expected, or this seems like some deficiency in my code?



On 06/23/2010 04:58 AM, Jonathan Ludlam wrote:
Have you looked here:


It might help?


On 23 Jun 2010, at 02:37, Abhishek Joshi wrote:

Hello All,

I am trying to gather xenserver statistics by parsing the xenserver rrd
files that reside on the xen host, by retrieving them via a python
plugin I have written.

I have a few issues I face here:

1. I see that some of the rdd files on the xenserver hosts under
/var/xapi/blobs/rrds are substantially bigger than the others. What this
leads to is a timeout at my end, when I encounter a big file and try to
read it back for parsing.

2. I saw quite a few NaN values when I looked at these files.

3. I was curious to know how the xen center collected statistics, and if
it indeed used the rrd files to parse through to collect statistics.

In any case, since the original java api is deprecated, this was the
only way out as far as collecting stats was concerned. Please let me
know if there is a better way to resolve this.

Any help would be highly appreciated.



xen-api mailing list

xen-api mailing list

<Prev in Thread] Current Thread [Next in Thread>