安装nginx-kafka插件ngx_kafka_module
生活随笔
收集整理的這篇文章主要介紹了
安装nginx-kafka插件ngx_kafka_module
小編覺得挺不錯的,現在分享給大家,幫大家做個參考.
1.安裝gityum install -y git
2.切換到/usr/local/src目錄,然后將kafka的c客戶端源碼clone到本地cd /usr/local/srcgit clone https://github.com/edenhill/librdkafka
3.進入到librdkafka,然后進行編譯cd librdkafkayum install -y gcc gcc-c++ pcre-devel zlib-devel./configuremake && make install4.安裝nginx整合kafka的插件,進入到/usr/local/src,clone nginx整合kafka的源碼cd /usr/local/srcgit clone https://github.com/brg-liuwei/ngx_kafka_module5.進入到nginx的源碼包目錄下 (編譯nginx,然后將將插件同時編譯)cd /usr/local/src/nginx-1.12.2./configure --add-module=/usr/local/src/ngx_kafka_module/makemake install6.修改nginx的配置文件,詳情請查看當前目錄的nginx.conf7.啟動zk和kafka集群(創建topic)/bigdata/zookeeper-3.4.9/bin/zkServer.sh start/bigdata/kafka_2.11-0.10.2.1/bin/kafka-server-start.sh -daemon /bigdata/kafka_2.11-0.10.2.1/config/server.properties8.啟動nginx,報錯,找不到kafka.so.1的文件error while loading shared libraries: librdkafka.so.1: cannot open shared object file: No such file or directory
9.加載so庫echo "/usr/local/lib" >> /etc/ld.so.confldconfig10.測試,向nginx中寫入數據,然后觀察kafka的消費者能不能消費到數據curl localhost/kafka/track -d "message send to kafka topic"curl localhost/kafka/track -d "何洪波666" 附件:nginx.conf#user nobody;
worker_processes 1;#error_log logs/error.log;
#error_log logs/error.log notice;
#error_log logs/error.log info;#pid logs/nginx.pid;events {worker_connections 1024;
}http {include mime.types;default_type application/octet-stream;#log_format main '$remote_addr - $remote_user [$time_local] "$request" '# '$status $body_bytes_sent "$http_referer" '# '"$http_user_agent" "$http_x_forwarded_for"';#access_log logs/access.log main;sendfile on;#tcp_nopush on;#keepalive_timeout 0;keepalive_timeout 65;#gzip on;kafka;kafka_broker_list node-1.xiaoniu.com:9092 node-2.xiaoniu.com:9092 node-3.xiaoniu.com:9092; server {listen 80;server_name node-6.xiaoniu.com;#charset koi8-r;#access_log logs/host.access.log main;location = /kafka/track {kafka_topic track;}location = /kafka/user {kafka_topic user;}#error_page 404 /404.html;# redirect server error pages to the static page /50x.html#error_page 500 502 503 504 /50x.html;location = /50x.html {root html;}}}
總結
以上是生活随笔為你收集整理的安装nginx-kafka插件ngx_kafka_module的全部內容,希望文章能夠幫你解決所遇到的問題。
- 上一篇: angular 脏值检测基础流程
- 下一篇: C语言打印矩形、长方形、平行四边形、各种