总用量 0 lrwxrwxrwx 1 root root 27 4月 12 14:58 ambari -> /home/hadoop/package/ambari lrwxrwxrwx 1 root root 13 4月 13 14:07 centos6 -> /mnt/centos6/ lrwxrwxrwx 1 root root 24 4月 12 14:58 HDP -> /home/hadoop/package/HDP lrwxrwxrwx 1 root root 12 4月 13 14:30 others -> /mnt/others/ lrwxrwxrwx 1 root root 11 4月 12 14:43 redhat -> /mnt/redhat
rhel-source.repo文件内容如下 [base] name=redhat server 6.4 baseurl=http://172.29.0.25/redhat enable=1 gpgcheck=0 [addons] name=centos6.4 baseurl=http://172.29.0.25/centos6 enable=1 gpgcheck=0 [extras] name=others baseurl=http://172.29.0.25/others enable=1 gpgcheck=0
yum repolist [root@hadoop-db yum.repos.d]# yum repolist Loaded plugins: product-id, refresh-packagekit, security, subscription-manager This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. repo id repo name status rhel-source Red Hat Enterprise Linux 6Server - x86_64 - Source 3,648 repolist: 3,648
yum clean all yum makecache [root@hadoop-db yum.repos.d]# yum clean all Loaded plugins: product-id, refresh-packagekit, security, subscription-manager This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. Cleaning repos: InstallMedia rhel-source Cleaning up Everything [root@hadoop-db yum.repos.d]# yum makecache Loaded plugins: product-id, refresh-packagekit, security, subscription-manager This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. rhel-source | 3.9 kB 00:00 ... rhel-source/group_gz | 204 kB 00:00 ... rhel-source/filelists_db | 3.7 MB 00:00 ... rhel-source/primary_db | 3.1 MB 00:00 ... rhel-source/other_db | 1.5 MB 00:00 ... Metadata Cache Created 3.4. 安装软件包
检查&安装scp, curl, unzip, tar, ntp and wget,http
[root@hadoop-db ~]# yum -y install openssh-clients [root@hadoop-db ~]# yum -y install wget [root@hadoop-db ~]# yum -y install unzip [root@hadoop-db ~]# yum -y install wget [root@hadoop-db ~]# yum -y install ntp [root@hadoop-db ~]# yum -y install http* [root@hadoop-db ~]# yum -y install expect 安装JDK，准备目录,如果存在，则不创建 mkdir /usr/java 上传jdk-7u67-linux-x64.tar.gz到/usr/java目录下，如果存在，则不创建 tar -xvzf jdk-7u67-linux-x64.tar.gz ln -s /usr/java/jdk1.7.0_67 /usr/java/default 配置所有用户Java变量，编辑/etc/profile文件，增加如下行， export JAVA_HOME=/usr/java/default export PATH=$JAVA_HOME/bin:$PATH export CLASSPATH=.:$JAVA_HOME/lib/tools.jar:$CLASSPATH
3.5. 修改系统配置参数
编辑/etc/hosts文件，增加3行 172.29.0.25hadoop-db.xxxxx.com.cnhadoop-db 172.29.0.226hadoop01-sit.xxxxx.com.cn hadoop01 172.29.0.227hadoop02-sit.xxxxx.com.cn hadoop02 172.29.0.228hadoop03-sit.xxxxx.com.cn hadoop03 172.29.0.229hadoop04-sit.xxxxx.com.cn hadoop04 172.29.0.21hadoop05-sit.xxxxx.com.cn hadoop05 172.29.0.22hadoop06-sit.xxxxx.com.cn hadoop06 172.29.0.23hadoop07-sit.xxxxx.com.cn hadoop07 172.29.0.24hadoop08-sit.xxxxx.com.cn hadoop08 关闭SELINUX，编辑/etc/selinux/config文件 SELINUX=disabled 配置Linux服务 chkconfig iptables off chkconfig ip6tables off chkconfig --levels 345 ntpd on
4. Slave节点及设置SSH互信 4.1. 设置SSH互信
以下操作在HADOOP-DB主机（第一台主机）上进行操作 [root@hadoop-db ~]# ssh-keygen -t rsa [root@hadoop-db ~]# cd .ssh [root@hadoop-db .ssh]# cat id_rsa.pub >> authorized_keys [root@hadoop-db .ssh]# cd .. [root@hadoop-db ~]# chmod 700 .ssh [root@hadoop-db ~]# chmod 600 .ssh/authorized_keys 执行如下Shell脚本， 1、auto_ssh.shhosts 完成后进行连通性测试 2、测试连通性： #!/bin/sh if [ $# -ne 1 ]; then echo \ echo \ hostsFile\ exit 1 fi HOSTS_FILE=$1 LOCALDATE=`date +%Y%m%d` for ip in `cat ${HOSTS_FILE}` do REMOTEDATE=`ssh ${ip} date +%Y%m%d` if [ ${LOCALDATE}==${REMOTEDATE} ];then echo \主机与远程IP${ip} 连通测试成功\ else fi done 结果： [root@hadoop-db script]# sh test_ssh.sh hosts 主机与远程IP172.29.0.25 连通测试成功 主机与远程IP172.29.0.226 连通测试成功 主机与远程IP172.29.0.227 连通测试成功 主机与远程IP172.29.0.228 连通测试成功 主机与远程IP172.29.0.229 连通测试成功 主机与远程IP172.29.0.21 连通测试成功 主机与远程IP172.29.0.22 连通测试成功 主机与远程IP172.29.0.23 连通测试成功 主机与远程IP172.29.0.24 连通测试成功 echo \主机与远程IP${ip} 连通测试失败\ 4.2. 各节点系统配置
1、 分发rhel-source.repo到各个节点 2、 安装NTP服务 3、 发布host解析文件 4、 设置Hostname（刚分到机器的时候就应该定义好，此处不再修改hostname） 5、 关闭主机防火墙和自启动选项 6、 关闭selinux，设置为disabled 7、 设置UMASK eachsetting.sh
5. 安装Ambari
5.1. 准备Ambari Local Repository
上传ambari-2.5.0.3-centos6.tar.gz，HDP-2.6.0.3-centos6-rpm.tar.gz, HDP-UTILS-1.1.0.21-centos6.tar.gz到 /home/hadoop/package目录，并解压 [root@hadoop-db html]# mkdir –p /home/hadoop/package [root@hadoop-dbpackage]# mkdir -p HDP/HDP-UTILS [root@hadoop-dbpackage]# mkdir -p ambari/centos6/2.x/updates/2.5.0.3 [root@hadoop-dbpackage]# mkdir -p HDP/HDP-2.6.0 [root@hadoop-dbpackage]# tar -xzf HDP-UTILS-1.1.0.21-centos6.tar.gz -C/home/hadoop/package/HDP/HDP-UTILS/ [root@hadoop-dbpackage]# tar -xzf HDP-2.6.0.3-centos6-rpm.tar.gz-C /home/hadoop/package/HDP/ HDP-2.6.0/ [root@hadoop-dbpackage]# tar -xzf ambari-2.5.0.3-centos6.tar.gz -C ambari/centos6/2.x/updates/2.5.0.3 [root@hadoop-db html]# ln -s /home/hadoop/package/ambari ambari [root@hadoop-db html]# ln -s /home/hadoop/package/HDP HDP [root@hadoop-db html]# ll 总用量 0 lrwxrwxrwx 1 root root 27 4月 12 14:58 ambari -> /home/hadoop/package/ambari lrwxrwxrwx 1 root root 24 4月 12 14:58 HDP -> /home/hadoop/package/HDP lrwxrwxrwx 1 root root 11 4月 12 14:43 redhat -> /mnt/redhat 打开浏览器测试http://172.29.0.25/redhat/, http://172.29.0.25/ambari/, http://172.29.0.25/HDP/
5.2. 修改和分发YUM Repository文件
将ambari.repo文件修改 #VERSION_NUMBER=2.5.0.3-7 [ambari-2.5.0.3] name=ambari Version - ambari-2.5.0.3 baseurl=http://public-repo-1.hortonworks.com/ambari/centos6/2.x/updates/2.5.0.3 gpgcheck=1 gpgkey=http://public-repo-1.hortonworks.com/ambari/centos6/2.x/updates/2.5.0.3/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins enabled=1 priority=1 修改为： #VERSION_NUMBER=2.5.0.3-7 [ambari-2.5.0.3] name=ambari Version - ambari-2.5.0.3 baseurl=http://172.29.0.25/ambari/centos6/2.x/updates/2.5.0.3 gpgcheck=1 gpgkey=http://172.29.0.25/ambari/centos6/2.x/updates/2.5.0.3/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins enabled=1 priority=1
5.3. 创建Ambari的Oracle用户
db_ambari
5.4. 安装AmbariServer
在HADOOP-DB节点，安装Ambari Server [root@hadoop-db ~]# yum -y install ambari-server
配置Ambari Server
[root@hadoop-db ~]# ambari-server setup #1、设置ambariserver 用户 [root@hadoop-db ~]# ambari-server setup Using python /usr/bin/python Setup ambari-server Checking SELinux... SELinux status is 'disabled' Customize user account for ambari-server daemon [y/n] (n)? n #2、设置JAVA_HOME： Adjusting ambari-server permissions and ownership... Checking firewall status... Checking JDK... [1] Oracle JDK 1.8 + Java Cryptography Extension (JCE) Policy Files 8 [2] Oracle JDK 1.7 + Java Cryptography Extension (JCE) Policy Files 7 [3] Custom JDK ============================================================================== Enter choice (1): 3 WARNING: JDK must be installed on all hosts and JAVA_HOME must be valid on all hosts. WARNING: JCE Policy files are required for configuring Kerberos security. If you plan to use Kerberos,please make sure JCE Unlimited Strength Jurisdiction Policy Files are valid on all hosts. Path to JAVA_HOME: /usr/java/jdk1.7.0_71 Validating JDK on Ambari Server...done. Completing setup... #3、设置元数据库，将Oracle JDBC 放入/usr/share/java Configuring database... Enter advanced database configuration [y/n] (n)? y Configuring database... ============================================================================== Choose one of the following options: [1] - PostgreSQL (Embedded) [2] - Oracle [3] - MySQL / MariaDB [4] - PostgreSQL [5] - Microsoft SQL Server (Tech Preview) [6] - SQL Anywhere [7] - BDB ============================================================================== Enter choice (1): 2 Hostname (localhost): hadoop-db Port (1521): 1521 Select Oracle identifier type: 1 - Service Name 2 - SID (1): 2 SID (ambari): xxxxx Username (ambari): db_ambari Enter Database Password (bigdata): Re-enter password: Configuring ambari database... WARNING: Before starting Ambari Server, you must copy the Oracle JDBC driver JAR file to /usr/share/java and set property \Press