You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
dsMin/Document/kafka的相关资料.txt

103 lines
2.0 KiB

This file contains ambiguous Unicode characters!

This file contains ambiguous Unicode characters that may be confused with others in your current locale. If your use case is intentional and legitimate, you can safely ignore this warning. Use the Escape button to highlight these characters.

1
Kafka的ack机制
https://www.jianshu.com/p/c98b934f2c2b
默认是ack=1 即leader写入算成功目前来看是可以了不需要修改。
Kafka的ACK机制有三种是哪三种
https://blog.csdn.net/Sun1181342029/article/details/87806207
Zookeeper单机版部署
部署步骤
1、下载zookeeper-3.4.8.tar.gz
2、解压tar -zxvf zookeeper-3.4.8.tar.gz
3、修改配置文件将$ZOOKEEPER_HOME/conf/zoo_sample.cfg复制重命名为zoo.cfg修改zoo.cfg
修改如下6个属性主要是修改dataDir与dataLogDir
tickTime=2000
initLimit=10
syncLimit=5
dataDir=/home/.../zookeeper-3.4.8/data
dataLogDir=/home/.../zookeeper-3.4.8/log
clientPort=2181
1
2
3
4
5
6
4、在设置的dataDir路径下添加文件myid在这个文件中echo 1作为单机版的节点id
5、设置zookeeper启动后zookeeper.out日志输出位置
修改脚本$ZOOKEEPER_HOME/bin/zkEnv.sh
if [ "x${ZOO_LOG_DIR}" = "x" ]
then
ZOO_LOG_DIR="/.../zookeeper/log"
fi
1
2
3
4
启动测试
1、进入$ZOOKEEPER_HOME/bin路径下 ./zkServer.sh start
2、./zkServer.sh status查看启动状态或者jps命令查看服务。QuorumPeerMain表示zookeeper服务
11729 QuorumPeerMain
24982 Jps
1
2
Kafka单机版部署
部署步骤
1、下载kafka_2.11-0.10.1.1.tgz
2、解压tar -zxvf kafka_2.11-0.10.1.1.tgz
3、设置kakfa环境变量,修改/etc/profile文件添加如下配置然后source /etc/profile使其生效
export KAFKA_HOME=/home/.../kafka_2.11-0.10.1.1
export PATH=$PATH:$KAFKA_HOME/bin
1
2
命令行输入kafkaTab键检查是否自动提示bin目录下命令检查是否配置成功
3、修改配置文件$KAFKA_HOME/config目录下的server.properties
设置如下参数其他参数使用默认值broker.id对应zookeeper中myid中的数值
broker.id=1
port=9092
host.name=localhost
# kafka代理地址
listeners=PLAINTEXT://:9092
log.dirs=/home/panfudong/soft/kafka/kafka_2.11-0.10.1.1/kafka-logs
zookeeper.connect=localhost:2181
1
2
3
4
5
6
7
8
9
10
启动测试
1、进入$KAFKA_HOME/bin路径
2、./kafka-server-start.sh --daemon ../config/server.properties启动kafka
3、使用jps命令查看进程出现Kafka表明启动成功
4、如果失败去$KAFKA_HOME/logs下查看server.log日志