This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
Home Products Support Community News


Re: [Xen-devel] [xen-unstable test] 4607: regressions - FAIL

To: "Jan Beulich" <JBeulich@xxxxxxxxxx>
Subject: Re: [Xen-devel] [xen-unstable test] 4607: regressions - FAIL
From: Ian Jackson <Ian.Jackson@xxxxxxxxxxxxx>
Date: Tue, 11 Jan 2011 12:22:38 +0000
Cc: xen-devel@xxxxxxxxxxxxxxxxxxx
Delivery-date: Tue, 11 Jan 2011 04:23:34 -0800
Envelope-to: www-data@xxxxxxxxxxxxxxxxxxx
In-reply-to: <4D26E62A020000780002AF1E@xxxxxxxxxxxxxxxxxx>
List-help: <mailto:xen-devel-request@lists.xensource.com?subject=help>
List-id: Xen developer discussion <xen-devel.lists.xensource.com>
List-post: <mailto:xen-devel@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=unsubscribe>
Newsgroups: chiark.mail.xen.devel
References: <osstest-4607-mainreport@xxxxxxx> <4D26E62A020000780002AF1E@xxxxxxxxxxxxxxxxxx>
Sender: xen-devel-bounces@xxxxxxxxxxxxxxxxxxx
Jan Beulich writes ("Re: [Xen-devel] [xen-unstable test] 4607: regressions - 
> hardens my suspicion that some of the tests (the leak-check/check
> ones in particular based on past observation) fail and succeed
> randomly. Shouldn't either tests that cause regular random false
> negatives be removed from the set (or at least made non-blocking),
> or regular random false positives imply that more than one run
> must succeed before an automatic push?

You are indeed right.  And the more tests we add the smaller the
bearable intermittent failure probability is.

I have changed the push gate logic so that it looks for tests of the
same revision, in the way that you did by hand, and doesn't block the
push if it finds that it passed in another run.

This ought to get us pushes more often.  It would still be nice to get
rid of some of these race bugs :-).


Xen-devel mailing list