环境准备

1，环境

centos7
ambari:192.168.6.140 --->hostname:hadoop00
node1: 192.168.6.138 -->hostname:hadoop01
node2:192.168.6.139 -->hostname:hadoop02

关闭防火墙selinux

systemctl stop firewalld
setenforce 0

2,修改对应机器主机名：

hostnamectl set-hostname hadoop00
hostnamectl set-hostname hadoop01
hostnamectl set-hostname hadoop02

3，每台机器做好解析

image.png

systemctl stop firewalld
setenforce 0

4，部署ntp服务（略）

部署

（server端操作）

1，部署http

yum -y install httpd
systemctl restart httpd
mkdir /var/www/html/ambari

2，实现免密操作

ssh-keygen
ssh-copy-id hadoop01
ssh-copy-id hadoop02

image.png

3，部署mysql

yum -y install mariadb mariadb-server
## 安装MySQL JDBC Connector：
yum -y install mysql-connector-java


##执行sql  创建Ambari帐号和hive服务帐号以及数据库
create database ambari default character set utf8;
grant all on ambari.* to ambari@localhost identified by 'bigdata';
grant all on ambari.* to ambari@'%' identified by 'bigdata';
create database hive default character set utf8;
grant all on hive.* to hive@localhost identified by 'hive';
grant all on hive.* to hive@'%' identified by 'hive';

4，下载官方镜像文件

Ambari 2.7.3.0:
https://docs.cloudera.com/HDPDocuments/Ambari-2.7.3.0/bk_ambari-installation/content/ambari_repositories.html
HDP-3.1.1.0:
https://docs.cloudera.com/HDPDocuments/Ambari-2.7.3.0/bk_ambari-installation/content/hdp_31_repositories.html

##需要下载的文件
HDP-3.1.0.0-centos7-rpm.tar.gz
HDP-GPL-3.1.0.0-centos7-gpl.tar.gz
HDP-UTILS-1.1.0.22-centos7.tar.gz
ambari-2.7.3.0-centos7.tar.gz

5，解压

tar xf ambari-2.7.3.0-centos7.tar.gz -C /var/www/html/ambari/
tar xf HDP-3.1.0.0-centos7-rpm.tar.gz -C /var/www/html/ambari/
tar xf HDP-GPL-3.1.0.0-centos7-gpl.tar.gz  -C /var/www/html/ambari/
tar xf HDP-UTILS-1.1.0.22-centos7.tar.gz -C /var/www/html/ambari/

6，配置ambari、HDP、HDP-UTILS本地源

[root@hadoop00 yum.repos.d]# cat hdp.repo 
#VERSION_NUMBER=3.1.0.0-78
[HDP-3.1.0.0]
name=HDP Version - HDP-3.1.0.0
baseurl=http://192.168.6.140/ambari/HDP/centos7/3.1.0.0-78/
gpgcheck=1
gpgkey=http://192.168.6.140/ambari/HDP/centos7/3.1.0.0-78/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins
enabled=1
priority=1

[HDP-UTILS-1.1.0.22]
name=HDP-UTILS Version - HDP-UTILS-
baseurl=http://192.168.6.140/ambari/HDP-UTILS/centos7/1.1.0.22/
gpgcheck=1
gpgkey=http://192.168.6.140/ambari/HDP-UTILS/centos7/1.1.0.22/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins
enabled=1
priority=1

[root@hadoop00 yum.repos.d]# cat ambari.repo 
#VERSION_NUMBER=2.7.3.0-139
[ambari-2.7.3.0]
name=ambari Version - ambari-2.7.3.0
baseurl=http://192.168.6.140/ambari/ambari/centos7/2.7.3.0-139/
gpgcheck=1
gpgkey=http://192.168.6.140/ambari/ambari/centos7/2.7.3.0-139/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins
enabled=1
priority=1

[root@hadoop00 yum.repos.d]# cat hdp.gpl.repo 
#VERSION_NUMBER=3.1.0.0-78
[HDP-GPL-3.1.0.0]
name=HDP-GPL Version - HDP-GPL-3.1.0.0
baseurl=http://192.168.6.140/ambari/HDP-GPL/centos7/3.1.0.0-78/
gpgcheck=1
gpgkey=http://192.168.6.140/ambari/HDP-GPL/centos7/3.1.0.0-78/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins
enabled=1
priority=1

yum clean all
yum makecache

7，安装ambari-server

yum install -y ambari-server

8，配置Ambari服务并启动

[root@hadoop00 ~]# ambari-server setup
Using python  /usr/bin/python
Setup ambari-server
Checking SELinux...
SELinux status is 'enabled'
SELinux mode is 'permissive'
WARNING: SELinux is set to 'permissive' mode and temporarily disabled.
OK to continue [y/n] (y)? 
Customize user account for ambari-server daemon [y/n] (n)? y
Enter user account for ambari-server daemon (root):ambari
Adjusting ambari-server permissions and ownership...
Checking firewall status...
Checking JDK...
Do you want to change Oracle JDK [y/n] (n)? y
[1] Oracle JDK 1.8 + Java Cryptography Extension (JCE) Policy Files 8
[2] Custom JDK
==============================================================================
Enter choice (1): 2
WARNING: JDK must be installed on all hosts and JAVA_HOME must be valid on all hosts.
WARNING: JCE Policy files are required for configuring Kerberos security. If you plan to use Kerberos,please make sure JCE Unlimited Strength Jurisdiction Policy Files are valid on all hosts.
Path to JAVA_HOME: /usr/local/java/
Validating JDK on Ambari Server...done.
Check JDK version for Ambari Server...
JDK version found: 8
Minimum JDK version is 8 for Ambari. Skipping to setup different JDK for Ambari Server.
Checking GPL software agreement...
GPL License for LZO: https://www.gnu.org/licenses/old-licenses/gpl-2.0.en.html
Enable Ambari Server to download and install GPL Licensed LZO packages [y/n] (n)? 
Completing setup...
Configuring database...
Enter advanced database configuration [y/n] (n)? y
Configuring database...
==============================================================================
Choose one of the following options:
[1] - PostgreSQL (Embedded)
[2] - Oracle
[3] - MySQL / MariaDB
[4] - PostgreSQL
[5] - Microsoft SQL Server (Tech Preview)
[6] - SQL Anywhere
[7] - BDB
==============================================================================
Enter choice (3): 3
Hostname (localhost): 
Port (3306): 
Database name (ambari): 
Username (ambari): 
Enter Database Password (bigdata): 
Configuring ambari database...
Should ambari use existing default jdbc /usr/share/java/mysql-connector-java.jar [y/n] (y)? n
Enter full path to custom jdbc driver: /usr/share/java/mysql-connector-java.jar
Configuring remote database connection properties...
WARNING: Before starting Ambari Server, you must run the following DDL directly from the database shell to create the schema: /var/lib/ambari-server/resources/Ambari-DDL-MySQL-CREATE.sql
Proceed with configuring remote database connection properties [y/n] (y)? 
Extracting system views...
ambari-admin-2.7.3.0.139.jar
....
Ambari repo file doesn't contain latest json url, skipping repoinfos modification
Adjusting ambari-server permissions and ownership...
Ambari Server 'setup' completed successfully.


##导入mysql的DDL文件
mysql  -uroot -p123456 ambari < /var/lib/ambari-server/resources/Ambari-DDL-MySQL-CREATE.sql


[root@hadoop00 ~]# ambari-server start
Using python  /usr/bin/python
Starting ambari-server
Ambari Server running with administrator privileges.
Organizing resource files at /var/lib/ambari-server/resources...
Ambari database consistency check started...
Server PID at: /var/run/ambari-server/ambari-server.pid
Server out at: /var/log/ambari-server/ambari-server.out
Server log at: /var/log/ambari-server/ambari-server.log
Waiting for server start...........................................
Server started listening on 8080

DB configs consistency check: no errors and warnings were found.
Ambari Server 'start' completed successfully.

[root@hadoop00 ~]# lsof -i:8080
COMMAND   PID   USER   FD   TYPE DEVICE SIZE/OFF NODE NAME
java    13193 ambari  574u  IPv6  44362      0t0  TCP *:webcache (LISTEN)

9,使用mysql数据库配置Ambari Web安装

image.png

4.2 安装向导创建集群

image.png

4.3 集群命名

image.png

4.4 选择安装版本并使用离线仓库

image.png

4.5 配置安装节点信息

image.png

4.6 安装ambari客户端

image.png

4.7 选择安装服务

image.png

4.8 分配服务器角色

image.png

这里保持默认即可,或者将控制服务都安装在一个节点上

4.9 分配slaves服务

image.png

4.10 配置服务

image.png

4.10.1 hive修改

cd /usr/share/java
ambari-server setup --jdbc-db=mysql --jdbc-driver=mysql-connector-java.jar

image.png

4.11 查看和确认预配置

image.png

4.12 安装组件

image.png

静静等待！！！！！！！！！！！！！！！！！！！！！！！

4.13 安装完成（我这里都已经安装完成了，但是启动失败，没关系，我们手动起服务，问题不大）

image.png

4.14 配置修改以及服务启动

image.png

Ambari部署hadoop集群

Ambari部署hadoop集群

环境准备

1，环境

2,修改对应机器主机名：

3，每台机器做好解析

4，部署ntp服务（略）

部署

（server端操作）

1，部署http

2，实现免密操作

3，部署mysql

4，下载官方镜像文件

5，解压

6，配置ambari、HDP、HDP-UTILS本地源

7，安装ambari-server

8，配置Ambari服务并启动

9,使用mysql数据库配置Ambari Web安装

4.2 安装向导创建集群

4.3 集群命名

4.4 选择安装版本并使用离线仓库

4.5 配置安装节点信息

4.6 安装ambari客户端

4.7 选择安装服务

4.8 分配服务器角色

4.9 分配slaves服务

4.10 配置服务

4.10.1 hive修改

4.11 查看和确认预配置

4.12 安装组件

4.13 安装完成（我这里都已经安装完成了，但是启动失败，没关系，我们手动起服务，问题不大）

4.14 配置修改以及服务启动