Installation Guide

Big data Cumulus-Linux installation guide

Issue link: https://read.uberflip.com/i/1123828

Contents of this Issue

Navigation

Page 9 of 26

B I G D AT A AN D C U MU L U S L I NU X : V AL I DA T E D DE SI G N GU I D E 10 4. Determine the IP Address That Your Servers Use If you are not going to leverage an existing DHCP setup, then you need to manually configure the IP addresses of your servers. Due to the static nature of the Hadoop configuration files, ensuring your master and backup systems have a stable IP address is critical, so it is suggested that they at a minimum have static IP addresses. The worker nodes within the cluster can have dynamic addresses, so long as DNS properly reflects this. The variety of configurations is outside of the scope of this document, so it will focus on a static IP address approach only. For your site, enumerate your servers, their IPMI IP addresses and your planned static IP addresses. For example: Server IPMI IP Address Static IP Address bigdata1 10.0.0.1 10.4.1.2 bigdata2 10.0.0.2 10.4.1.3 bigdata3 10.0.0.3 10.4.2.2 bigdata4 10.0.0.4 10.4.2.3 bigdata5 10.0.0.5 10.4.3.2 bigdata6 10.0.0.6 10.4.3.3 bigdata7 10.0.0.7 10.4.4.2 bigdata8 10.0.0.8 10.4.4.3 5. Select Master and Backup Systems Two nodes are required to run extra functions on them and so act as the master scheduler, HDFS name node, job control system and other functions within the Hadoop cluster. For availability reasons, nominating a backup is also suggested. These two systems should also have as few single common points of failure as possible, so they should be in different racks, connected to different leaf nodes and should have as independent power as is supported in your deployment. If you choose to have local DNS, this should also be run on the master and backup systems for consistency. For example, bigdata1 is the designated master and bigdata8 is the designated backup. Static configurations are leveraged for DNS and IP addresses.

Articles in this issue

view archives of Installation Guide - Big data Cumulus-Linux installation guide