serrsync:
1.什么是实时同步
监控一个目录的变化,当该目录触发事件(创建/删除/修改)就执行动作,这个动作可以是rsync同步,也可以是其他
2.为什么要实时同步
- 能解决nfs单点故障的问题
- 能够让本地快速切换至云端
3.实时同步的原理
借助一个通知接口,inotify. inotify监控本地主机的事件(创建/删除/修改),当本地主机触发事件后,就执行动作,这个动作可以是rsync
4.实时同步的场景
能解决nfs单点故障的问题
-
能够让本地快
速切换至云端
5.实时同步工具选择
- inotify+rsync实现,只不过需要通过脚本来实现监控,并且放在后台screen
- 写脚本
- 同步
- sersync实现同步
- lsync
6.实时同步案例演示
规划:
image.png
| 服务器名称 | 外网ip | 内网ip | 服务 |
|---|---|---|---|
| web | 10.0.0.7 | 172.16.1.7 | httpd/php |
| nfs | 10.0.0.31 | 172.16.1.31 | nfs inotify sync sersync |
| backup | 10.0.0.41 | 172.16.1.41 | rsync nfs |
nfs服务端
-
- 安装nfs
[root@nfs ~]# yum install nfs-utils -y
- 配置
[root@nfs ~]# vim /etc/exports
/data 172.16.1.0/24(rw,sync,all_squash,anonuid=666,anongid=666)
- 初始化环境
[root@nfs ~]# groupadd -g 666 www
[root@nfs ~]# useradd -u666 -g666 www
[root@nfs ~]# mkdir /data
[root@nfs ~]# chown -R www.www /data/
- 重启nfs服务
[root@nfs ~]# systemctl restart nfs-server
[root@nfs ~]# systemctl enable nfs-server
web服务端操作
-
- 安装
[root@web01 ~]# yum install httpd php -y- 配置httpd php
- 启动httpd
[root@web01 ~]# systemctl start httpd- 模拟测试
[root@web01 ~]# echo "Oldboy Edu.com" > /var/www/html/index.html (可以不测试) -
WEB进行挂载,上传代码:
[root@web01 ~]# mount -t nfs 172.16.1.31:/data /var/www/html/ [root@web01 ~]# cd /var/www/html [root@web01 ~]# rz kaoshi.zip [root@web01 ~]# unzip kaoshi.zip用户通过前端的wen页面上上传视频
如果上传出现错误:请检查日志
[root@web01 html]# tail -f /var/log/httpd/error_log
同步到backup服务器的backup模块
-
- 安装
[root@backup ~]# yum install rsync -y- 配置rsync
[root@backup ~]# cat /etc/rsyncd.conf uid = rsync gid = rsync port = 873 fake super = yes use chroot = no max connections = 200 timeout = 600 ignore errors read only = false list = false auth users = rsync_backup secrets file = /etc/rsync.passwd log file = /var/log/rsyncd.log ##################################### [backup] comment = welcome to oldboyedu backup! path = /backup [data] path = /data
- 根据rsync配置初始化环境
[root@backup ~]# useradd -M -s /sbin/nologin rsync
[root@backup ~]# echo "rsync_backup:123456" > /etc/rsync.passwd
[root@backup ~]# chmod 600 /etc/rsync.passwd
[root@backup ~]# mkdir /backup /data -p
[root@backup ~]# chown -R rsync.rsync /backup/ /data/
- 启动rsync
[root@backup ~]# systemctl restart rsyncd
[root@backup ~]# systemctl enable rsyncd
nfs服务配置
-
- 安装rsync inotify
[root@nfs ~]# yum install rsync inotify-tools -y- 安装sersync (rsync inotify)
[root@nfs ~]# wget https://github.com/wsgzao/sersync/raw/master/sersync2.5.4_64bit_binary_stable_final.tar.gz [root@nfs ~]# tar xf sersync2.5.4_64bit_binary_stable_final.tar.gz -C /usr/local/ [root@nfs ~]# mv /usr/local/GNU-Linux-x86/ /usr/local/sersync [root@nfs01 sersync]# vim confxml.xml <?xml version="1.0" encoding="ISO-8859-1"?> <head version="2.5"> <host hostip="localhost" port="8008"></host> <debug start="false"/> <fileSystem xfs="false"/> #文件系统 <filter start="false"> #排除不想同步的文件 <exclude expression="(.*)\.svn"></exclude> <exclude expression="(.*)\.gz"></exclude> <exclude expression="^info/*"></exclude> <exclude expression="^static/*"></exclude> </filter> <inotify> #监控的事件类型 <delete start="true"/> <createFolder start="true"/> <createFile start="true"/> <closeWrite start="true"/> <moveFrom start="true"/> <moveTo start="true"/> <attrib start="false"/> <modify start="true"/> </inotify> <sersync> <localpath watch="/data"> #监控的目录 <remote ip="172.16.1.41" name="data"/> #backup的ip以及模块 <!--<remote ip="192.168.8.39" name="tongbu"/>--> <!--<remote ip="192.168.8.40" name="tongbu"/>--> </localpath> <rsync> #rsync的选项 <commonParams params="-avz"/> <auth start="true" users="rsync_backup" passwordfile="/etc/rsync.pass"/> <userDefinedPort start="false" port="874"/><!-- port=874 --> <timeout start="false" time="100"/><!-- timeout=100 --> <ssh start="false"/> </rsync> <failLog path="/tmp/rsync_fail_log.sh" timeToExecute="60"/><!--default every 60mins execute once--> <crontab start="false" schedule="600"><!--600mins--> <crontabfilter start="false"> <exclude expression="*.php"></exclude> <exclude expression="info/*"></exclude> </crontabfilter> </crontab> <plugin start="false" name="command"/> </sersync> <plugin name="command"> <param prefix="/bin/sh" suffix="" ignoreError="true"/> <!--prefix /opt/tongbu/mmm.sh suffix--> <filter start="false"> <include expression="(.*)\.php"/> <include expression="(.*)\.sh"/> </filter> </plugin> <plugin name="socket"> <localpath watch="/opt/tongbu"> <deshost ip="192.168.138.20" port="8009"/> </localpath> </plugin> <plugin name="refreshCDN"> <localpath watch="/data0/htdocs/cms.xoyo.com/site/"> <cdninfo domainname="ccms.chinacache.com" port="80" username="xxxx" passwd="xxxx"/> <sendurl base="http://pic.xoyo.com/cms"/> <regexurl regex="false" match="cms.xoyo.com/site([/a-zA-Z0-9]*).xoyo.com/images"/> </localpath> </plugin>
</head>
[root@nfs ~]# file /usr/local/sersync/confxml.xml
[root@nfs ~]# echo "123456" > /etc/rsync.pass
[root@nfs ~]# chmod 600 /etc/rsync.pass
3. 启动sersync
```bash
[root@nfs ~]# /usr/local/sersync/sersync2 -dro /usr/local/sersync/confxml.xml
- 建议:手动执行该命令测试是否OK,这样方便排查问题
[root@nfs ~]# cd /data && rsync -avz -R --delete ./ --timeout=100 rsync_backup@172.16.1.41::data --password-file=/etc/rsync.pass
模拟NFS故障,当web可以快速切换到backup的NFS服务上
1.backup的权限是否和NFS权限一致
2.backup上是否配置NFS服务,是否共享了/data
3.模拟NFS故障,实现切换
-
backup的权限是否和NFS的权限一致 10.0.0.41 172.16.1.41
修改内容如下:
[root@backup ~]# vim /etc/rsyncd.conf
uid = www
gid = www
.....
创建用户
[root@backup ~]# groupadd -g 666 www
[root@backup ~]# useradd -g666 -u666 www
修改权限
[root@backup ~]# chown -R www.www /data/ /backup/
重启服务
[root@backup ~]# systemctl restart rsyncd
- backup服务器上是否配置NFS服务?是否共享了/data目录
安装NFS
[root@backup ~]# yum install nfs-utils -y
配置NFS
[root@backup ~]# cat /etc/exports
/data 172.16.1.0/24(rw,sync,all_squash,anonuid=666,anongid=666)
[root@backup ~]# chown -R www.www /data/
启动NFS
[root@backup ~]# systemctl enable nfs-server
[root@backup ~]# systemctl start nfs-server
- 模拟NFS故障,实现切换
[root@web01 ~]# umount -lf /var/www/html && mount -t nfs 172.16.1.41:/data /var/www/html
