WARNING - OLD ARCHIVES

This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
   
 
 
Xen 
 
Home Products Support Community News
 
   
 

xen-users

Re: [Xen-users] Hadoop Cluster on Xen

To: Lance Haig <lhaig@xxxxxxxxxxxx>
Subject: Re: [Xen-users] Hadoop Cluster on Xen
From: rajan chandi <chandi.rajan@xxxxxxxxx>
Date: Mon, 9 Nov 2009 15:39:44 +0530
Cc: xen-users@xxxxxxxxxxxxxxxxxxx
Delivery-date: Mon, 09 Nov 2009 02:10:29 -0800
Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:cc:content-type; bh=44RY4OFn83z3ksSfwZ7HLtXGBexJrbKpty55z6hTEqM=; b=B/SMPRpYtDGY1CUy/YWLvacOLl2TCnu4nJMeSAMak/cI7M4jBXv79E2aF8tyN/Z4Fw MLXNk5NoH3PZNBwpADojBK9UhRDwlhxUYy3m9z7CSU7eAVIUf03+He8l34K0aTV/jxib aZx6vNv1xEHaYY/S2xJfeYZy8BjqNjjEz+p2M=
Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; b=EUR+VMkX1t62exOQiKrl5/f4NxcpAOAlpqYnaUJuq6PzN0hO8yULsyK16pDC6LmxFS MPT7YiHKmNIkjN9150VS7tiQGAScsH9a98BozSVns6EV4R9mqn6DYn8ZcZbeEdElhsB7 5exebUF5wOr0SMLFv6ALNKUaC/eAIkotz6ZSE=
Envelope-to: www-data@xxxxxxxxxxxxxxxxxxx
In-reply-to: <4AF7247F.6070603@xxxxxxxxxxxx>
List-help: <mailto:xen-users-request@lists.xensource.com?subject=help>
List-id: Xen user discussion <xen-users.lists.xensource.com>
List-post: <mailto:xen-users@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/mailman/listinfo/xen-users>, <mailto:xen-users-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/mailman/listinfo/xen-users>, <mailto:xen-users-request@lists.xensource.com?subject=unsubscribe>
References: <1257507099.2901.2.camel@lancehaig> <a70bf0e20911060520r6552b4a1m7a986ebe8bd9792@xxxxxxxxxxxxxx> <4AF7247F.6070603@xxxxxxxxxxxx>
Sender: xen-users-bounces@xxxxxxxxxxxxxxxxxxx

Hi Lance,

It's not hard to create the cluster. We are using Xen over Debian Lenny.

We're yet to release our SAAS product in production.

So, We've not load tested it yet.

What were your decision factors in choosing HD over other File Systems?

Our research states that MogileFS is more scalable and good for small files..while HDFS is good for large files.

Regards
Rajan

On Mon, Nov 9, 2009 at 1:35 AM, Lance Haig <lhaig@xxxxxxxxxxxx> wrote:
Hi rajan,

We currently run a 10 hadoop cluster on 3 vmware hosts and I want to create a bigger cluster on a xen cluster of servers. so I was just wanting to find out how easy it is. Our HD cluster maxes out the vmware CPUs for about 4 Hours a day doing our analysis.

So I think your answer says it all for me. It is possible so we should test.

Thanks

Lance

rajan chandi wrote:
We are working on MogileFS cloud storage over Xen!

We're going to store documents of small size ~1 MB.

What is your business case?

Regards
Rajan

On Fri, Nov 6, 2009 at 5:01 PM, Lance Haig <lhaig@xxxxxxxxxxxx <mailto:lhaig@xxxxxxxxxxxx>> wrote:

   Hi all,


   Has anyone created a Xen cluster to run a hadoop vm cluster?

   I would be interested in how it performs

   Thanks

   Lance


   --
   This message has been scanned for viruses and
   dangerous content by MailScanner, and is
   believed to be clean.


   _______________________________________________
   Xen-users mailing list
   Xen-users@xxxxxxxxxxxxxxxxxxx <mailto:Xen-users@xxxxxxxxxxxxxxxxxxx> --
This message has been scanned for viruses and
dangerous content by *MailScanner* <http://www.mailscanner.info/>, and is

believed to be clean.


------------------------------------------------------------------------

_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-users


--
This message has been scanned for viruses and
dangerous content by MailScanner, and is
believed to be clean.


_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-users
<Prev in Thread] Current Thread [Next in Thread>