Archived copy. This page was recovered from the Internet Archive snapshot of /display/SP/Local Platform instance at KB taken on 2016-09-11. The original wiki at wiki.opf-labs.org is being decommissioned.

Local Platform instance at KB

Created by Clemens Neudecker on Sep 24, 2012 · last edited by Clemens Neudecker · on Sep 24, 2012 (view history) · 5 versions

Basic cluster software

Ubuntu 10.04 LTS x86_64

OpenSSH

Cluster Setup (2012.09): Cloudera CDH3u4

JDK 6 update 22 - x64 (jdk-6u22-linux-x64.bin)

Current cluster software setup & history

2012.09

Hadoop 0.20.2+923.256
PIG 0.8.1+28.32
HADOOP_HEAPSIZE=1000
MAP / REDUCE slot ratio 6/1

Cluster hardware

NETWORK infrastructure

The CONTROLLER and the NODEs are connected through a 100Mbps network of the hosting provider (Leaseweb).

CONTROLLER

Dell Poweredge R210
CPU: 1 x Xeon [email protected] Quadcore CPU (8 HyperThreading cores)
RAM: 4GB
NIC: 2 x 100Mbps Ethernet (1 used)
DISK: 2 x 250GB DISKs; configured as RAID1 (redundancy) => 250GB effective disk space

Local Platform instance at KB

Basic cluster software

Current cluster software setup & history

Cluster hardware

NETWORK infrastructure

CONTROLLER

NODE (worker nodes 1 to 6)