Powered by OPF
OPF WIKI STATIC ARCHIVE
2,681 pages · 153 spaces · 776 tags · 4,025 history records · 96.2% of the original wiki recovered
Archived copy. This page was recovered from the Internet Archive snapshot of /pages/viewpage.action?pageId=33980464 taken on 2021-05-12. The original wiki at wiki.opf-labs.org is being decommissioned.

UVT Hadoop Platform

Added by Daniel Pop · last edited by Daniel Pop · on Oct 11, 2013

UVT Hadoop Platform

Field
Datatype
Value
Description
Platform-ID String UVT Hadoop platform
Unique string that identifies this specific platform.
Use the platform name
Platform description String This Hadoop platform is setup for preservation experiments
Human readable description of the platform. Where is it located, contact info, etc.
Number of nodes integer 8 HP ProLiant DL-385 servers
Number of hosts involved - could be both physical hosts as well as virtual hosts
Total number of physical CPUs integer 16 Number of CPU's involved
CPU specs string CPU AMD Opteron 2.4 GHz, dual core, 1 MB L2 cache per core Specification of CPUs
Total number of CPU-cores integer 32 cores
Number of CPU-cores involved
Total amount of RAM in Gbytes
integer 4 GB RAM / node x 8 = 32GB (total)
Total amount of RAM on all nodes
average CPU-cores for nodes
integer 4 Number of CPU-cores in average across all nodes
avarage RAM in Gbytes for nodes
integer 4 GB
Amount of memory in average across all nodes
Operating System on nodes
String CentOS 6 Linux (specific distribution), Windows (specific distribution), other?
Storage system/layer String
  • NFS Staging: max 512GB
  • HDFS Storage: ~400GB
NFS, HDFS, local files, ?
Network layer between nodes String Each node is equipped with 2 NICs 1 Gb/s
  • 1 NIC for NAS access
  • 1 NIC for Hadoop Operation
Speed of network interfaces, general network speed
       

   

Parallel Execution System

Field Value
Installation description InfraGRID Cluster:
  • IBM LoadLeveler based system
Configuration notes Click here for details.

Benchmarks of Parallel Execution System

Metric Benchmark type Value Description