How to run hadoop shell script and install hive on it within 5minutes

 HADOOP INSTALLATION:

 

 

 

 

HIVE INSTALLATION: 

hduser@ubuntu:~$ wget https://downloads.apache.org/hive/hive-3.1.2/apache-hive-3.1.2-bin.tar.gz 

hduser@ubuntu:~$ tar xzf apache-hive-3.1.2-bin.tar.gz

hduser@ubuntu:~$ nano .bashrc

 
hduser@ubuntu:~$ source ~/.bashrc
hduser@ubuntu:~$ nano $HIVE_HOME/bin/hive-config.sh

 
 
 
 
 
 
 
hduser@ubuntu:~$ hdfs dfs -mkdir /tmp
hduser@ubuntu:~$ hdfs dfs -chmod g+w /tmp
hduser@ubuntu:~$ hdfs dfs -ls /
 
hduser@ubuntu:~$ hdfs dfs -mkdir -p /user/hive/warehouse
hduser@ubuntu:~$ hdfs dfs -chmod g+w /user/hive/warehouse
hduser@ubuntu:~$ hdfs dfs -ls /user/hive
 

hduser@ubuntu:~$ cd $HIVE_HOME/conf
hduser@ubuntu:~/apache-hive-3.1.2-bin/conf$ 
hduser@ubuntu:~/apache-hive-3.1.2-bin/conf$ cp hive-default.xml.template hive-site.xml
hduser@ubuntu:~/apache-hive-3.1.2-bin/conf$ nano hive-site.xml
<property>
    <name>system:java.io.tmpdir</name>
    <value>/tmp/hive/java</value>
  </property>
  <property>
    <name>system:user.name</name>
    <value>${user.name}</value>
  </property>

hduser@ubuntu:~/apache-hive-3.1.2-bin/conf$ schematool -initSchema -dbType derby

To remove error we need to follow these steps

hduser@ubuntu:~/apache-hive-3.1.2-bin/conf$ ls $HIVE_HOME/lib
hduser@ubuntu:~/apache-hive-3.1.2-bin/conf$ ls $HADOOP_HOME/share/hadoop/hdfs/lib

hduser@ubuntu:~/apache-hive-3.1.2-bin/conf$ rm $HIVE_HOME/lib/guava-19.0.jar
hduser@ubuntu:~/apache-hive-3.1.2-bin/conf$ cp $HADOOP_HOME/share/hadoop/hdfs/lib/guava-27.0-jre.jar $HIVE_HOME/lib/
hduser@ubuntu:~/apache-hive-3.1.2-bin/conf$ schematool -initSchema -dbType derby

now identify the error caused by schematool

hduser@ubuntu:~/apache-hive-3.1.2-bin/conf$ nano hive-site.xml

NOTE:by pressing ctrl+t we can go to the error line

3225,96

hduser@ubuntu:~/apache-hive-3.1.2-bin/conf$ schematool -initSchema -dbType derby