Posts

Showing posts from September, 2020

Step by step procedure for HADOOP installation on UBUNTU

Open terminal in UBUNTU and execute the fallowing commands one by one   1)sudo apt update 2)sudo apt install openjdk-8-jdk -y 3)java -version; javac -version 4)sudo apt install openssh-server openssh-client -y 5)ssh-keygen -t rsa -P '' -f ~/.ssh/id_rsa 6)cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys 7)chmod 0600 ~/.ssh/authorized_keys 8)ssh localhost 9)wget https://downloads.apache.org/hadoop/common/hadoop-3.2.1/hadoop-3.2.1.tar.gz 10)tar xzf hadoop-3.2.1.tar.gz 11)sudo nano .bashrc #Hadoop Related Options export HADOOP_HOME=/home/hadoop-3.2.1 export HADOOP_INSTALL=$HADOOP_HOME export HADOOP_MAPRED_HOME=$HADOOP_HOME export HADOOP_COMMON_HOME=$HADOOP_HOME export HADOOP_HDFS_HOME=$HADOOP_HOME export YARN_HOME=$HADOOP_HOME export HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_HOME/lib/native export PATH=$PATH:$HADOOP_HOME/sbin:$HADOOP_HOME/bin export HADOOP_OPTS=”-Djava.library.path=$HADOOP_HOME/lib/native” 12)source ~/.bashrc 13)sudo nano $HADOOP_HOME/etc/hadoop/hadoop-env.sh expor