WARNING - OLD ARCHIVES

This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
   
 
 
Xen 
 
Home Products Support Community News
 
   
 

xen-devel

Re: [Xen-devel] xen regression test

To: Kip Macy <kip.macy@xxxxxxxxx>
Subject: Re: [Xen-devel] xen regression test
From: James Bulpin <james@xxxxxxxxxxxxx>
Date: Thu, 22 Sep 2005 21:14:36 +0100
Cc: xen-devel <xen-devel@xxxxxxxxxxxxxxxxxxx>
Delivery-date: Thu, 22 Sep 2005 20:12:25 +0000
Envelope-to: www-data@xxxxxxxxxxxxxxxxxxx
In-reply-to: <b1fa29170509221301a256fcf@xxxxxxxxxxxxxx>
List-help: <mailto:xen-devel-request@lists.xensource.com?subject=help>
List-id: Xen developer discussion <xen-devel.lists.xensource.com>
List-post: <mailto:xen-devel@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/cgi-bin/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/cgi-bin/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=unsubscribe>
References: <b1fa29170509221301a256fcf@xxxxxxxxxxxxxx>
Sender: xen-devel-bounces@xxxxxxxxxxxxxxxxxxx
User-agent: Mozilla Thunderbird 1.0.2 (Windows/20050317)
Kip Macy wrote:
I was looking at the results of the runs at:

http://xenbits.xensource.com/xenrt/

It looks like many of the tests never get run and some of those that are getting run are skipped at times. What determines which tests are getting run and which are skipped?

The matrix axes contains tests that have not yet been written and/or integrated into the harness. This includes all of phases 5 and 6 and a few tests elsewhere such as crashme.

Tests will be skipped for two reasons. Firstly if we want to "fast-forward" to test something late in the sequence and we don't want to wait for everything preceding it to run (this often happens to verify that a specific bug fix has worked). Secondly if a test is not valid for that particular combination of machine/architecture/version etc.. For example we now skip tbench and dbench on x86-64 because they don't build on that architecture and we've not had time to fix them.

James

_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel

<Prev in Thread] Current Thread [Next in Thread>