正文

centos install kafka and zookeeper

IP云
IP云V管理员/3 阅读
09/01
提示：扫一扫查出行
【扫一扫了解最新限行尾号】
复制提示

1.安装zookeeper

ZooKeeper is a distributed, open-source coordination service for distributed applications.
1.下载
wget http://apache.fayea.com/zookeeper/zookeeper-3.3.6/zookeeper-3.3.6.tar.gz
2.解压复制
sudo mv zookeeper-3.3.6 /var/

3.编辑配置文件
在/var/zookeeper-3.3.6 下面的conf 里面有一个zoo_sample.cfg 复制一个zoo.cfg 然后编辑内容。我这里是都放在/var/data/下的 所以配置是这样的

# The number of milliseconds of each tick
tickTime=
# The number of ticks that the initial
# synchronization phase can take
initLimit=
# The number of ticks that can pass between
# sending a request and getting an acknowledgement
syncLimit=
# the directory where the snapshot is stored.
dataDir=/var/data/zookeeper
# the port at which the clients will connect
clientPort=

在此之前在先新建文件夹以及权限设置这种

4.启动

进入到bin目录 执行./zkServer.sh start

然后ps-ef|grep zoo能看到进程说明已经启动成功

5.测试

在bin目录下执行./zkCli.sh -server 127.0.0.1 然后下面会出现一堆日志信息

正常的是这样的

Connecting to 127.0.0.1:
-- ::, - INFO [main:Environment@] - Client environment:zookeeper.version=3.3.-, built on // : GMT
-- ::, - INFO [main:Environment@] - Client environment:host.name=iZ2322gd8vdZ
-- ::, - INFO [main:Environment@] - Client environment:java.version=1.7.0_67
-- ::, - INFO [main:Environment@] - Client environment:java.vendor=Oracle Corporation
-- ::, - INFO [main:Environment@] - Client environment:java.home=/usr/java/jdk1..0_67/jre
-- ::, - INFO [main:Environment@] - Client environment:java.class.path=/var/zookeeper-3.3./bin/../build/classes:/var/zookeeper-3.3./bin/../build/lib/*.jar:/var/zookeeper-3.3.6/bin/../zookeeper-3.3.6.jar:/var/zookeeper-3.3.6/bin/../lib/log4j-1.2.15.jar:/var/zookeeper-3.3.6/bin/../lib/jline-0.9.94.jar:/var/zookeeper-3.3.6/bin/../src/java/lib/*.jar:/var/zookeeper-3.3.6/bin/../conf:.:/usr/java/jdk1.7.0_67/lib:/usr/java/jdk1.7.0_67/jre/lib
2016-12-14 15:33:45,081 - INFO [main:Environment@97] - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2016-12-14 15:33:45,081 - INFO [main:Environment@97] - Client environment:java.io.tmpdir=/tmp
2016-12-14 15:33:45,082 - INFO [main:Environment@97] - Client environment:java.compiler=<NA>
2016-12-14 15:33:45,082 - INFO [main:Environment@97] - Client environment:os.name=Linux
2016-12-14 15:33:45,083 - INFO [main:Environment@97] - Client environment:os.arch=amd64
2016-12-14 15:33:45,083 - INFO [main:Environment@97] - Client environment:os.version=2.6.32-431.23.3.el6.x86_64
2016-12-14 15:33:45,084 - INFO [main:Environment@97] - Client environment:user.name=root
2016-12-14 15:33:45,084 - INFO [main:Environment@97] - Client environment:user.home=/root
2016-12-14 15:33:45,084 - INFO [main:Environment@97] - Client environment:user.dir=/var/zookeeper-3.3.6/bin
2016-12-14 15:33:45,086 - INFO [main:ZooKeeper@379] - Initiating client connection, connectString=127.0.0.1:2181 sessionTimeout=30000 watcher=org.apache.zookeeper.ZooKeeperMain$MyWatcher@13a1d5cb
Welcome to ZooKeeper!
2016-12-14 15:33:45,102 - INFO [main-SendThread():ClientCnxn$SendThread@1058] - Opening socket connection to server /127.0.0.1:2181
2016-12-14 15:33:45,110 - INFO [main-SendThread(localhost:2181):ClientCnxn$SendThread@947] - Socket connection established to localhost/127.0.0.1:2181, initiating session
JLine support is enabled
2016-12-14 15:33:45,120 - INFO [main-SendThread(localhost:2181):ClientCnxn$SendThread@736] - Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x158fc21940d0002, negotiated timeout = 30000

到这里zookeeper就安装结束了有什么不明白的可以去官网看看.这个是独立安装 也可以用kafka里面的那个

2.安装kafka

1.下载

 wget http://apache.fayea.com/kafka/0.10.1.0/kafka_2.10-0.10.1.0.tgz

惯例解压然后复制

tar -xvf kafka_2.10-0.10.1.0

mv kafka_2.10-0.10.1.0 /var/

2.编辑配置文件

在kafka下面执行

vi bin/kafka-server-start.sh 默认

export KAFKA_HEAP_OPTS="-Xmx1G -Xms1G" 我用的是这个 ，根据大家的配置自己配置就可以了

3.启动

bin/kafka-server-start.sh config/server.properties &

4.测试

1.新建topic

bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic test

2.查看新建的topic

bin/kafka-topics.sh --list --zookeeper localhost:2181

3.使用刚才新建的topic 新建一个消息

bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test

然后就可以输入了

我随便输入的hello 1212121

4.再开一个终端 执行bin下面的

bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic test --from-beginning

会看到输入的信息，至此全部完成。关于客户端的用法会在接下来的文章里出现