环境说明
$ 命令行提示符，安装过程中需要执行的命令
172.16.10.11 k8s-master1
172.16.10.12 k8s-master2
172.16.10.13 k8s-master3
172.16.10.14 k8s-node1
172.16.10.15 k8s-node2
172.16.10.16 k8s-node3
172.16.10.17 k8s-node4
三个master节点安装etcd数据库
etcd 版本 3.4.10
flannel 版本 0.12.0
kubernetes 版本 18.6
所有节点都为centos7，提前关闭防火墙、selinux
$ systemctl disable firewalld
$ systemctl stopfirewalld
$ setenforce 0
$ sed -ri 's/SELINUX=enforcing/SELINUX=disabled/g' /etc/selinux/config
下载安装包
kubernetes Github下载地址
https://dl.k8s.io/v1.18.6/kubernetes-server-linux-amd64.tar.gz
etcdh Github下载地址
https://github.com/etcd-io/etcd/releases/download/v3.4.10/etcd-v3.4.10-linux-amd64.tar.gz
部署ETCD集群
下载安装cfssl工具
$ wget https://pkg.cfssl.org/R1.2/cfssl_linux-amd64
$ wget https://pkg.cfssl.org/R1.2/cfssljson_linux-amd64
$ wget https://pkg.cfssl.org/R1.2/cfssl-certinfo_linux-amd64
$ chmod +x cfssl_linux-amd64 cfssljson_linux-amd64 cfssl-certinfo_linux-amd64
$ mv cfssl_linux-amd64 /usr/local/bin/cfssl
$ mv cfssljson_linux-amd64 /usr/local/bin/cfssljson
$ mv cfssl-certinfo_linux-amd64 /usr/bin/cfssl-certinfo
生成证书
创建以下三个文件：
$ cat ca-config.json
{
"signing": {
"default": {
"expiry": "87600h"
},
"profiles": {
"www": {
"expiry": "87600h",
"usages": [
"signing",
"key encipherment",
"server auth",
"client auth"
]
}
}
}
}
$ cat ca-csr.json
{
"CN": "etcd CA",
"key": {
"algo": "rsa",
"size": 2048
},
"names": [
{
"C": "CN",
"L": "Beijing",
"ST": "Beijing"
}
]
}
$ cat server-csr.json
{
"CN": "etcd",
"hosts": [
"172.16.10.11",
"172.16.10.12",
"172.16.10.13"
],
"key": {
"algo": "rsa",
"size": 2048
},
"names": [
{
"C": "CN",
"L": "BeiJing",
"ST": "BeiJing"
}
]
}
$ cfssl gencert -initca ca-csr.json | cfssljson -bare ca -
$ cfssl gencert -ca=ca.pem -ca-key=ca-key.pem -config=ca-config.json -profile=www server-csr.json | cfssljson -bare server
$ ls *pem
生成以下4个文件表示成功
ca-key.pem ca.pem server-key.pem server.pem
安装Etcd
创建安装etcd所需要的目录
$ mkdir /opt/etcd/{bin,cfg,ssl,data} -p
创建etcd配置文件
$ cat /opt/etcd/cfg/etcd
#[Member]
ETCD_NAME="etcd01"
ETCD_DATA_DIR="/var/lib/etcd/default.etcd"
ETCD_LISTEN_PEER_URLS="https://172.16.10.11:2380"
ETCD_LISTEN_CLIENT_URLS="https://172.16.10.11:2379"
#[Clustering]
ETCD_INITIAL_ADVERTISE_PEER_URLS="https://172.16.10.11:2380"
ETCD_ADVERTISE_CLIENT_URLS="https://172.16.10.11:2379"
ETCD_INITIAL_CLUSTER="etcd01=https://172.16.10.11:2380,etcd02=https://172.16.10.12:2380,etcd03=https://172.16.10.13:2380"
ETCD_INITIAL_CLUSTER_TOKEN="etcd-cluster"
ETCD_INITIAL_CLUSTER_STATE="new"
# flannel操作etcd使用的是v2的API，而kubernetes操作etcd使用的v3的API，为了兼容flannel，将默认开启v2版本
ETCD_ENABLE_V2="true"
参数说明
- ETCD_NAME 节点名称
- ETCD_DATA_DIR 数据目录
- ETCD_LISTEN_PEER_URLS 集群通信监听地址
- ETCD_LISTEN_CLIENT_URLS 客户端访问监听地址
- ETCD_INITIAL_ADVERTISE_PEER_URLS 集群通告地址
- ETCD_ADVERTISE_CLIENT_URLS 客户端通告地址
- ETCD_INITIAL_CLUSTER 集群节点地址
- ETCD_INITIAL_CLUSTER_TOKEN 集群Token
- ETCD_INITIAL_CLUSTER_STATE 加入集群的当前状态，new是新集群，existing表示加入已有集群
systemd管理etcd
$ cat /usr/lib/systemd/system/etcd.service
[Unit]
Description=Etcd Server
After=network.target
After=network-online.target
Wants=network-online.target
[Service]
Type=notify
EnvironmentFile=/opt/etcd/cfg/etcd
ExecStart=/opt/etcd/bin/etcd \
--cert-file=/opt/etcd/ssl/server.pem \
--key-file=/opt/etcd/ssl/server-key.pem \
--peer-cert-file=/opt/etcd/ssl/server.pem \
--peer-key-file=/opt/etcd/ssl/server-key.pem \
--trusted-ca-file=/opt/etcd/ssl/ca.pem \
--peer-trusted-ca-file=/opt/etcd/ssl/ca.pem
Restart=on-failure
LimitNOFILE=65536
把刚才生成的证书拷贝到配置文件中的位置：
$ cp ca*pem server*pem /opt/etcd/ssl/
同步文件到另外两台服务器
$ rsync -av /opt/etcd 172.16.10.12:/opt/
$ rsync -av /opt/etcd 172.16.10.13:/opt/
同步完成后记得修改另外两个节点中/opt/etcd/cfg/etcd配置文件中的三个配置：
ETCD_NAME
ETCD_LISTEN_PEER_URLS
ETCD_LISTEN_CLIENT_URLS
同步systemd配置文件
$ scp /usr/lib/systemd/system/etcd.service 172.16.10.12:/usr/lib/systemd/system/etcd.service
scp /usr/lib/systemd/system/etcd.service 172.16.10.13:/usr/lib/systemd/system/etcd.service
启动并设置开启启动，三台服务器都要操作
$ systemctl daemon-reload
$ systemctl start etcd
$ systemctl enable etcd
