Apache ZooKeeper 单机、集群部署文档

提示：扫一扫查出行
【扫一扫了解最新限行尾号】
复制提示

简介：

Apache ZooKeeper 是一个分布式应用的高性能协调服务，功能包括：配置维护、统一命名、状态同步、集群管理、仲裁选举等。

下载地址：http://apache.fayea.com/zookeeper/zookeeper-3.4.10/zookeeper-3.4.10.tar.gz

官方文档：http://zookeeper.apache.org/doc/r3.4.10/zookeeperStarted.html

一、安装 ZooKeeper

shell > java -version

java version "1.8.0_111"

Java(TM) SE Runtime Environment (build 1.8.0_111-b14)

Java HotSpot(TM) -Bit Server VM (build 25.111-b14, mixed mode)

# JAVA 是必不可少的

shell > cd /usr/local/src

shell > wget http://apache.fayea.com/zookeeper/zookeeper-3.4.10/zookeeper-3.4.10.tar.gz

shell > tar zxf zookeeper-3.4..tar.gz -C ../

shell > chown -R root.root /usr/local/zookeeper-3.4.

二、配置、启动、客户端、停止 ZooKeeper

1、生成配置文件

shell > cd /usr/local/zookeeper-3.4.

shell > cp conf/zoo_sample.cfg conf/zoo.cfg

2、启动 ZooKeeper

shell > sh bin/zkServer.sh start

# 查看进程ID

shell > jps

 QuorumPeerMain

# 端口监听状态

shell > netstat -lnpt | grep

tcp               :::                     :::*                        LISTEN      /java

# ZooKeeper 启动模式 standalone

shell > sh bin/zkServer.sh status

ZooKeeper JMX enabled by default

Using config: /usr/local/zookeeper-3.4./bin/../conf/zoo.cfg

Mode: standalone

3、客户端连接

shell > sh bin/zkCli.sh -server localhost:

# 打印根目录

[zk: localhost:(CONNECTED) ] ls /

[zookeeper]

# 层级目录

[zk: localhost:(CONNECTED) ] ls /zookeeper

[quota]

# 显示帮助信息

[zk: localhost:(CONNECTED) ] ?

ZooKeeper -server host:port cmd args

    stat path [watch]

    set path data [version]

    ls path [watch]

    delquota [-n|-b] path

    ls2 path [watch]

    setAcl path acl

    setquota -n|-b val path

    history

    redo cmdno

    printwatches on|off

    delete path [version]

    sync path

    listquota path

    rmr path

    get path [watch]

    create [-s] [-e] path data acl

    addauth scheme auth

    quit

    getAcl path

    close

    connect host:port

# ZooKeeper 维护着一个类似文件系统的内存结构
# 连接时不指定 -server 默认连接本机 2181 端口
# 当输入 ZooKeeper 无法识别的指令时，打印帮助信息

4、停止 ZooKeeper

shell > sh bin/zkServer.sh stop

三、ZooKeeper 集群部署

192.168.1.27 datanode01.hadoop
192.168.1.28 datanode02.hadoop
192.168.1.29 datanode03.hadoop

# 部署 ZooKeeper 集群，建议 3 台及以上奇数主机 ( 涉及到仲裁问题 )

# JAVA、下载、解压、修改属主、组

1、修改配置文件

shell > vim conf/zoo.cfg

# 心跳间隔 毫秒

tickTime=

# 初始化时，允许的超时心跳间隔次数

initLimit=

# Leader 与 Follower 同步数据允许的超时心跳间隔次数

syncLimit=

# 监听端口

clientPort=

# 数据目录

dataDir=/data/zookeeper/data

# 日志目录

dataLogDir=/data/zookeeper/logs

# ZooKeeper Server 地址，通信端口、选举端口

server.=192.168.1.27::

server.=192.168.1.28::

server.=192.168.1.29::

# 每台都要有哦~

2、创建目录

shell > mkdir -p /data/zookeeper/{data,logs}

# 每台都要有哦~

3、生成节点标识文件

shell > echo  > /data/zookeeper/data/myid

shell > echo  > /data/zookeeper/data/myid

shell > echo  > /data/zookeeper/data/myid

# 分别在三台服务器上执行，需要跟配置文件中的 server.1\2\3 对应

4、启动 ZooKeeper

shell > ansible datanode -m shell -a '/usr/local/zookeeper-3.4.10/bin/zkServer.sh start'

datanode02.hadoop | SUCCESS | rc= >>

Starting zookeeper ... STARTEDZooKeeper JMX enabled by default

Using config: /usr/local/zookeeper-3.4./bin/../conf/zoo.cfg

datanode03.hadoop | SUCCESS | rc= >>

Starting zookeeper ... STARTEDZooKeeper JMX enabled by default

Using config: /usr/local/zookeeper-3.4./bin/../conf/zoo.cfg

datanode01.hadoop | SUCCESS | rc= >>

Starting zookeeper ... STARTEDZooKeeper JMX enabled by default

Using config: /usr/local/zookeeper-3.4./bin/../conf/zoo.cfg

# 全部成功启动

shell > ansible datanode -m shell -a '/usr/local/zookeeper-3.4.10/bin/zkServer.sh status'
datanode03.hadoop | SUCCESS | rc=0 >>
ZooKeeper JMX enabled by default
Using config: /usr/local/zookeeper-3.4.10/bin/../conf/zoo.cfg
Mode: leader

datanode02.hadoop | SUCCESS | rc=0 >>
ZooKeeper JMX enabled by default
Using config: /usr/local/zookeeper-3.4.10/bin/../conf/zoo.cfg
Mode: follower

datanode01.hadoop | SUCCESS | rc=0 >>
ZooKeeper JMX enabled by default
Using config: /usr/local/zookeeper-3.4.10/bin/../conf/zoo.cfg
Mode: follower

# 查看状态，datanode03.hadoop 为 leader ，其余两台为 follower

5、验证选举

shell > sh bin/zkServer.sh stop

# 关闭 datanode03.hadoop 服务器上的 ZooKeeper，原 leader

shell > ansible datanode -m shell -a '/usr/local/zookeeper-3.4.10/bin/zkServer.sh status'
datanode03.hadoop | FAILED | rc=1 >>
Error contacting service. It is probably not running.ZooKeeper JMX enabled by default
Using config: /usr/local/zookeeper-3.4.10/bin/../conf/zoo.cfg

datanode02.hadoop | SUCCESS | rc=0 >>
ZooKeeper JMX enabled by default
Using config: /usr/local/zookeeper-3.4.10/bin/../conf/zoo.cfg
Mode: leader

datanode01.hadoop | SUCCESS | rc=0 >>
ZooKeeper JMX enabled by default
Using config: /usr/local/zookeeper-3.4.10/bin/../conf/zoo.cfg
Mode: follower

# 再次查看状态，datanode02.hadoop 升级为 leader，datanode01.hadoop 仍为 follower

# 注意：三台 ZooKeeper Server 组成的集群，当两台故障时，整个集群失败 ( 剩余的一台无法继续提供服务 )

6、客户端连接

shell > sh bin/zkCli.sh -server 192.168.1.27:,192.168.1.28:,192.168.1.29:

# 注意：
# 客户端连接集群，只写一个地址时，当这台 Server 宕机，则客户端连接失败
# 同时写多个地址( 全写 )时，除集群失败外，不影响客户端连接
# 写多个地址时，以 , 分割，, 两边不能有空格

shell > sh bin/zkCli.sh -server 192.168.1.27:

[zk: 192.168.1.27:(CONNECTED) ] ls /

[zookeeper]

# 客户端只连接 1.27，显示只有一个默认的 znode

shell > sh bin/zkCli.sh -server 192.168.1.28:

[zk: 192.168.1.28:(CONNECTED) ] ls /

[zookeeper]

[zk: 192.168.1.28:(CONNECTED) ] create /zk 'mydata'

Created /zk

[zk: 192.168.1.28:(CONNECTED) ] ls /

[zk, zookeeper]

[zk: 192.168.1.28:(CONNECTED) ] get /zk

mydata

cZxid = 0x400000005

ctime = Thu May  :: CST

mZxid = 0x400000005

mtime = Thu May  :: CST

pZxid = 0x400000005

cversion =

dataVersion =

aclVersion =

ephemeralOwner = 0x0

dataLength =

numChildren =

# 新客户端连接 1.28，创建一个 znode

shell >

[zk: 192.168.1.27:(CONNECTED) ] ls /

[zk, zookeeper]

[zk: 192.168.1.27:(CONNECTED) ] get /zk

mydata

cZxid = 0x400000005

ctime = Thu May  :: CST

mZxid = 0x400000005

mtime = Thu May  :: CST

pZxid = 0x400000005

cversion =

dataVersion =

aclVersion =

ephemeralOwner = 0x0

dataLength =

numChildren =

# 刚才连接的 1.27，可以显示、获取这个新建的 znode

shell >

[zk: 192.168.1.27:(CONNECTED) ] set /zk 'share'

cZxid = 0x400000005

ctime = Thu May  :: CST

mZxid = 0x400000006

mtime = Thu May  :: CST

pZxid = 0x400000005

cversion =

dataVersion =

aclVersion =

ephemeralOwner = 0x0

dataLength =

numChildren =

# 给这个 znode 重新设置一个值

shell >

[zk: 192.168.1.28:(CONNECTED) ] get /zk

share

cZxid = 0x400000005

ctime = Thu May  :: CST

mZxid = 0x400000006

mtime = Thu May  :: CST

pZxid = 0x400000005

cversion =

dataVersion =

aclVersion =

ephemeralOwner = 0x0

dataLength =

numChildren =

# 连接 1.28 的客户端，也获取到了更新后的值

shell >

[zk: 192.168.1.28:(CONNECTED) ] delete /zk

[zk: 192.168.1.28:(CONNECTED) ] ls /

# 删除创建的 znode

# 实验表明：
# ZooKeeper 是任意读写的！

正文

相关阅读

redis集群跨网访问，ca722航班回国经过

mysql切换集群命令，mysql集群主从切换如何知道

linux下redis集群部署，redis sentinel 集群

redis集群和主备，redis集群备份和恢复

mssqlserver集群，sql server 2019集群

emqx架构设计解析，emq集群原理

hadoopredis集成，超详细的hadoop集群部署

linux中redis集群搭建，redis508集群搭建

目录[+]