manual/enterprise/bigdata-hadoop-terasort

Description

Functional tests of hadoop

Maintainer

• milosz.wasilewski@linaro.org

OS

• CentOS

Scope

• performance

Devices

• d02
• d03
• d05
• overdrive
• moonshot

Steps to reproduce

• Make sure OpenJDK8 is installed by typing: $ java -version NOTE: If this step fails, then fail the test
• Follow the steps of Installation from wiki 'https://wiki.linaro.org/LEG/Engineering/BigData/Installing_Hadoop_2_7_2_Spark_2_0_Hive_2_1_0'
• Verify ODPi hadoop installation. By typing: $ hadoop
• Configure: Add Hadoop User - hduser
• Configure: Generate ssh key for hduser
• Configure: Disable IPv6
• Configure: Configure the app environment
• Configure: Setup Environment Variables
• Configure: Modify config files. core-site.xml, mapred-site.xml, hdfs-site.xml
• Format Namenode
• Start YARN daemons
• Validate if Hadoop and all resource managers are running
• Run teragen, terasort and teravalidate