当前位置: 首页 > Linux

linux下kafka安装及基本操作

时间:2023-04-07 00:13:15 Linux

下载Kafkahttp://archive.apache.org/dist/kafka/1.1.0/解压并重命名cd/usr/localtarzxvfkafka_2.12-1.1.0.tgzmvkafka_2.12-1.1.0kafka_2.12-1.1.0/Configurekafkamkdir/usr/local/kafka/log/kafka#创建kafka日志目录cd/usr/local/kafka/config#进入配置目录viserver.properties#编辑修改相应参数broker.id=0port=9092#端口号host.name=hostname#hostnamelisteners=PLAINTEXT://hostname:9092log.dirs=/usr/local/kafka/log/kafka#日志存放路径,上面创建的目录zookeeper.connect=localhost:2181#zookeeper地址和端口,单机配置部署,localhost:2181configurezookeepermkdir/usr/local/kafka/zookeeper#创建zookeeper目录mkdir/usr/local/kafka/log/zookeeper#创建zookeeper日志目录cd/usr/local/kafka/config#进入配置目录vizookeeper.properties#编辑修改相应参数dataDir=/usr/local/kafka/zookeeper#zookeeper数据目录dataLogDir=/usr/local/kafka/log/zookeeper#zookeeper日志目录clientPort=2181maxClientCnxns=100tickTime=2000initLimit=10syncLimit=5以上配置使用了kafka的自动zookeeper,不需要单独安装zookeeper启动脚本vikafkastart.sh#编辑,添加如下代码#!/bin/sh#启动zookeeper/usr/local/kafka/bin/动物园管理员服务器-start.sh/usr/local/kafka/config/zookeeper.properties&sleep3#3秒后执行#启动kafka/usr/local/kafka/bin/kafka-server-start.sh/usr/local/kafka/config/server.properties&Stopscriptvikafkastop.sh#编辑,添加如下代码#!/bin/sh#关闭zookeeper/usr/local/kafka/bin/zookeeper-server-stop.sh/usr/local/kafka/config/zookeeper.properties&sleep3#3秒后执行#关闭kafka/usr/local/kafka/bin/kafka-server-stop.sh/usr/local/kafka/config/server.properties&创建一个Topicbin/kafka-topics.sh--create--zookeeperlocalhost:2181--replication-factor1--partitions1--topictest上面的命令是创建一个名为test的topic,副本数为1,分区数为1。查看Topicbin/kafka-topics。sh--list--zookeeperlocalhost:2181发送消息bin/kafka-console-producer.sh--broker-listhostname:9092--topic测试消费消息bin/kafka-console-consumer.sh--bootstrap-serverhostname:9092--topictest--from-beginning注意hostname和配置中的hostname一定要一致