當(dāng)前位置：首頁(yè) > 编程资源 > 编程问答 >内容正文

编程问答

生产环境elasticsearch5.0.1和6.3.2集群的部署配置详解

發(fā)布時(shí)間：2025/7/14 编程问答 23 豆豆

生活随笔收集整理的這篇文章主要介紹了生产环境elasticsearch5.0.1和6.3.2集群的部署配置详解小編覺得挺不錯(cuò)的,現(xiàn)在分享給大家,幫大家做個(gè)參考.

線上環(huán)境elasticsearch5.0.1集群的配置部署

es集群的規(guī)劃：
硬件：
7臺(tái)8核、64G內(nèi)存、2T ssd硬盤加1臺(tái)8核16G的阿里云服務(wù)器

其中一臺(tái)作為kibana+kafka連接查詢的服務(wù)器
其他6臺(tái)都作為node和master兩種角色

操作系統(tǒng)：centos7.2 x86_64
為方便磁盤擴(kuò)容建議將磁盤進(jìn)行l(wèi)vm邏輯卷配置，可以參考：
aliyun添加數(shù)據(jù)盤后的物理分區(qū)和lvm邏輯卷兩種掛載方式
http://blog.csdn.net/reblue520/article/details/54174178

1.安裝jdk1.8和elasticsearch5.0.1

rpm -ivh jdk-8u111-linux-x64.rpm
tar -zxvf elasticsearch-5.0.1.tar.gz

2.添加yunva這個(gè)運(yùn)行elasticsearch的用戶(es必須使用非root用戶啟動(dòng))

useradd yunva -d /home/yunva
echo 'pass'|passwd --stdin yunva

chown -R yunva.yunva /data

修改默認(rèn)端口
sed -i 's/#Port 22/Port 2222/' /etc/ssh/sshd_config
sed -i 's/^GSSAPIAuthentication yes$/GSSAPIAuthentication no/' /etc/ssh/sshd_config
service sshd restart

3.針對(duì)es做的一些系統(tǒng)的優(yōu)化配置

swapoff -a

echo "fs.file-max = 1000000" >> /etc/sysctl.conf
echo "vm.max_map_count=262144" >> /etc/sysctl.conf
echo "vm.swappiness = 1" >> /etc/sysctl.conf

sysctl -p
sed -i 's/* soft nofile 65535/* soft nofile 655350/g' /etc/security/limits.conf
sed -i 's/* hard nofile 65535/* hard nofile 655350/g' /etc/security/limits.conf

將java_home加入環(huán)境變量
cat >> /etc/profile <<EOF
export JAVA_HOME=/usr/java/jdk1.8.0_111?
export PATH=\$JAVA_HOME/bin:\$PATH
EOF

source /etc/profile

4.es內(nèi)存調(diào)整配置文件(建議配置為物理內(nèi)存的一半或者更多最好不要超過(guò)32G，超過(guò)了也可能不會(huì)增強(qiáng)性能)：

/data/elasticsearch-5.0.1/config/jvm.options

sed -i 's/-Xms2g/-Xms32g/' /data/elasticsearch-5.0.1/config/jvm.options
sed -i 's/-Xmx2g/-Xmx32g/' /data/elasticsearch-5.0.1/config/jvm.options
echo "-Xss256k" >>/data/elasticsearch-5.0.1/config/jvm.options

sed -i 's/-XX:+UseConcMarkSweepGC/-XX:+UseG1GC/' /data/elasticsearch-5.0.1/config/jvm.options

5.集群的主要配置文件

修改elasticsearch的參數(shù)
vim /etc/elasticsearch/elasticsearch.yml(rpm安裝方式的配置文件位置)
vim ?/data/elasticsearch-5.0.1/config/elasticsearch.yml

es節(jié)點(diǎn)的配置：
# 節(jié)點(diǎn)名
cluster.name: yunva-es
# 集群的名稱，可以不寫
discovery.zen.ping.unicast.hosts: ["node-1","yunva_etl_es2", "yunva_etl_es3","yunva_etl_es4","yunva_etl_es5","yunva_etl_es6","yunva_etl_es7"]
node.name: yunva_etl_es6
node.master: true
node.data: true
path.data: /data/es/data
path.logs: /data/es/logs
action.auto_create_index: false
indices.fielddata.cache.size: 12g
bootstrap.memory_lock: false
# 內(nèi)網(wǎng)地址，可以加快速度
network.host: 192.168.1.10
http.port: 9200
# 增加新的參數(shù)head插件可以訪問(wèn)es
http.cors.enabled: true
http.cors.allow-origin: "*"

gateway.recover_after_time: 8m
gateway.expected_nodes: 3
cluster.routing.allocation.node_initial_primaries_recoveries: 8

# 以下配置可以減少當(dāng)es節(jié)點(diǎn)短時(shí)間宕機(jī)或重啟時(shí)shards重新分布帶來(lái)的磁盤io讀寫浪費(fèi)
discovery.zen.fd.ping_timeout: 180s
discovery.zen.fd.ping_retries: 8
discovery.zen.fd.ping_interval: 30s
discovery.zen.ping_timeout: 120s

針對(duì)kibana的es配置(非node和master節(jié)點(diǎn))
# cat /etc/elasticsearch/elasticsearch.yml
cluster.name: yunva-es
node.name: yunva_etl_es1
node.master: false
node.data: false
node.ingest: false

action.auto_create_index: false
path.data: /data/es/data
path.logs: /data/es/logs
bootstrap.memory_lock: false
network.host: 0.0.0.0
http.port: 9200

http.cors.enabled: true
http.cors.allow-origin: "*"

注意修改配置文件vim /etc/hosts 列出集群節(jié)點(diǎn)名稱和對(duì)應(yīng)ip地址的對(duì)應(yīng)關(guān)系(有內(nèi)網(wǎng)dns并且配置的就不需要再次配置了)

echo "10.28.50.131 node-1" >> /etc/hosts
echo "10.26.241.239 yunva_etl_es3" >> /etc/hosts
echo "10.25.135.215 yunva_etl_es2" >> /etc/hosts
echo "10.26.241.237 yunva_etl_es4" >> /etc/hosts
echo "10.27.78.228 yunva_etl_es5" >> /etc/hosts
echo "10.27.65.121 yunva_etl_es6" >> /etc/hosts
echo "10.27.35.94 yunva_etl_es7" >> /etc/hosts

6.創(chuàng)建日志和數(shù)據(jù)存放目錄

mkdir -p /data/es/data
mkdir /data/es/logs
chown -R yunva.yunva /data

7.啟動(dòng)es服務(wù)：

# su - yunva
[yunva]$ cd /data/elasticsearch-5.0.1/bin/
./elasticsearch &

8.檢查單臺(tái)服務(wù)是否正常：

$ curl http://ip:9200/
{
? "name" : "yunva_etl_es5",
? "cluster_name" : "yunva-es",
? "cluster_uuid" : "2shAg8u3SjCRNJ4mEUBzBQ",
? "version" : {
? ? "number" : "5.0.1",
? ? "build_hash" : "080bb47",
? ? "build_date" : "2016-11-11T22:08:49.812Z",
? ? "build_snapshot" : false,
? ? "lucene_version" : "6.2.1"
? },
? "tagline" : "You Know, for Search"
}

# 查看集群狀態(tài)
$ curl http://ip:9200/_cluster/health/?pretty
{
? "cluster_name" : "yunva-es",
? "status" : "green",
? "timed_out" : false,
? "number_of_nodes" : 5,
? "number_of_data_nodes" : 4,
? "active_primary_shards" : 66,
? "active_shards" : 132,
? "relocating_shards" : 2,
? "initializing_shards" : 0,
? "unassigned_shards" : 0,
? "delayed_unassigned_shards" : 0,
? "number_of_pending_tasks" : 0,
? "number_of_in_flight_fetch" : 0,
? "task_max_waiting_in_queue_millis" : 0,
? "active_shards_percent_as_number" : 100.0
}

然后將配置好的es程序拷貝到其他服務(wù)器中，注意修改以下內(nèi)容(network.host為內(nèi)網(wǎng)地址，速度更快，節(jié)省互相復(fù)制、分片的時(shí)候處理帶寬)：
1.elasticsearch.yml文件的配置修改
node.name: 節(jié)點(diǎn)名稱
network.host: es節(jié)點(diǎn)的內(nèi)網(wǎng)IP地址
2./etc/hosts文件中內(nèi)網(wǎng)ip和node.name的對(duì)應(yīng)關(guān)系

后續(xù)添加對(duì)集群服務(wù)的監(jiān)控，可以參考：

elasticsearch6.0的安裝

一、確定服務(wù)器配置，新建硬件資源需要配置es集群作為熱數(shù)據(jù)，數(shù)據(jù)量不大，兩臺(tái)8核16G，200G磁盤的服務(wù)器做es集群即可二、初始化系統(tǒng)1、關(guān)閉firewall，并安裝iptables服務(wù) systemctl stop firewalld.service #停止firewallsystemctl disable firewalld.service #禁止firewall開機(jī)啟動(dòng)yum install iptables-services -y# 添加防火墻規(guī)則 vim /usr/local/worksh/FireWall.sh#!/bin/bash iptables -A INPUT -p udp --dport 1701 -j ACCEPT ################################################################ ### Required modules /sbin/modprobe ip_tables /sbin/modprobe ip_conntrack /sbin/modprobe iptable_mangle /sbin/modprobe iptable_nat /sbin/modprobe ipt_LOG /sbin/modprobe ipt_limit /sbin/modprobe ipt_state /sbin/modprobe ip_conntrack_ftp /sbin/modprobe ip_nat_ftp /sbin/modprobe ipt_owner /sbin/modprobe ipt_REJECT### Clean Rules iptables -P INPUT ACCEPT iptables -P FORWARD ACCEPT iptables -P OUTPUT ACCEPT iptables -t nat -P PREROUTING ACCEPT iptables -t nat -P POSTROUTING ACCEPT iptables -t nat -P OUTPUT ACCEPT iptables -t mangle -P PREROUTING ACCEPT iptables -t mangle -P OUTPUT ACCEPT iptables -F iptables -t nat -F #iptables -t mangle -F iptables -X iptables -t nat -X #iptables -t mangle -X### Drop all pocket,first iptables -P INPUT DROP #iptables -P OUTPUT DROP iptables -P FORWARD DROP### Create New chains iptables -N bad_tcp_packets #iptables -N allowed iptables -N icmp_packets### Bad_tcp_packets chain /sbin/iptables -A bad_tcp_packets -p tcp ! --syn -m state --state NEW -j DROP /sbin/iptables -A bad_tcp_packets -p tcp --tcp-flags ALL ALL -j DROP /sbin/iptables -A bad_tcp_packets -p tcp --tcp-flags ALL NONE -j DROP /sbin/iptables -A bad_tcp_packets -p tcp --tcp-flags SYN,FIN SYN,FIN -j DROP /sbin/iptables -A bad_tcp_packets -p tcp --tcp-flags SYN,RST SYN,RST -j DROP /sbin/iptables -A bad_tcp_packets -p tcp --tcp-flags FIN,RST FIN,RST -j DROP /sbin/iptables -A bad_tcp_packets -p tcp --tcp-flags ACK,FIN FIN -j DROP /sbin/iptables -A bad_tcp_packets -p tcp --tcp-flags ACK,PSH PSH -j DROP /sbin/iptables -A bad_tcp_packets -p tcp --tcp-flags ACK,URG URG -j DROP### ICMP Rules iptables -A icmp_packets -p icmp --icmp-type 8 -j ACCEPT iptables -A icmp_packets -p icmp --icmp-type 11 -j ACCEPT #iptables -A icmp_packets -p icmp -j DROP##keepalived iptables -A INPUT -i eth1 -p vrrp -s 63.159.217.139 -j ACCEPT### LookBack and Private interface iptables -A INPUT -p ALL -i lo -j ACCEPT iptables -A INPUT -p ALL -i eth0 -j ACCEPT### INPUT chain iptables -A INPUT -p tcp -j bad_tcp_packets iptables -A INPUT -p icmp -j icmp_packets iptables -A INPUT -p ALL -m state --state ESTABLISHED,RELATED -j ACCEPT### 5666 EOP iptables -A INPUT -p tcp -i eth1 --dport 5666 -s 47.91.75.80 -j ACCEPT##rep iptables -A INPUT -p tcp -i eth1 --dport 3306 -s 47.91.90.28 -j ACCEPT# Count Limit #iptables -A INPUT -m limit --limit 3/minute --limit-burst 3 -j LOG --log-level INFO --log-prefix "IPT INPUT PACKET DIED:" ############################################################ iptables -I INPUT -p udp --dport 1701 -j ACCEPT### Open Ports Public_access="80 443 8080" Server_access="20 21 873 3306 2008 8899 9200 9300" Company_access="20 21 873 9200 9300 9100" aliyun_access="3306" ### Allow IpsServers_ip="192.168.254.0/24" Company_ip="1.1.1.1" aliyun_ip="2.2.2.2" Eus_server_ip="3.3.3.3"### Public access Rules for port in $Public_access doiptables -A INPUT -p tcp -i eth1 --dport $port -j ACCEPT done### Servers access Rules for port in $Server_access dofor ip in $Servers_ipdoiptables -A INPUT -p tcp -i eth1 --dport $port -s $ip -j ACCEPTdone done### Eus_server access Rules for port in $Server_access dofor ip in $Eus_server_ipdoiptables -A INPUT -p tcp -i eth1 --dport $port -s $ip -j ACCEPTdone done### Company access Rules for port in $Company_access dofor ip in $Company_ipdoiptables -A INPUT -p tcp -i eth1 --dport $port -s $ip -j ACCEPTdone done# chmod +x /usr/local/worksh/FireWall.sh # sh -x /usr/local/worksh/FireWall.sh# 開機(jī)運(yùn)行防火墻規(guī)則 [root@cms_elasticsearch01 elasticsearch-head]# tail -n 1 /etc/rc.local /usr/local/worksh/FireWall.sh*********************# centos7設(shè)置洛杉磯時(shí)間timedatectl set-timezone America/Los_Angeles# 修改文件句柄 sed -i 's#root soft nofile 65535#root soft nofile 655350#g' /etc/security/limits.conf sed -i 's#root hard nofile 65535#root hard nofile 655350#g' /etc/security/limits.conf sed -i 's#* soft nofile 65535#* soft nofile 655350#g' /etc/security/limits.conf sed -i 's#* hard nofile 65535#* hard nofile 655350#g' /etc/security/limits.conf sed -i 's#* soft nproc 4096##g' /etc/security/limits.d/20-nproc.conf# 最終效果 root soft nofile 655350 root hard nofile 655350 * soft nofile 655350 * hard nofile 655350# 安裝依賴 yum install -y gcc gcc-c++ htop telnet iotop iptraf iftop make logrotate xinetd ntsysv sysstat perl autoconf libjpeg libjpeg-devel libpng libpng-devel glibc glibc-devel glib2 glib2-devel bzip2 bzip2-devel ncurses ncurses-devel e2fsprogs e2fsprogs-devel krb5-devel libidn libidn-devel libxml2 libxml2-devel libxslt-devel libevent-devel libtool libtool-ltdl bison ntpdate patch vim wget openssh-clients bind-utils# 系統(tǒng)升級(jí)到最新 yum update -y# 安裝jdk1.8_181rpm -ivh jdk-8u181-linux-x64.rpm # vim /etc/profile export JAVA_HOME=/usr/java/jdk1.8.0_181-amd64 export PATH=$JAVA_HOME/bin:$PATH4.添加運(yùn)行elasticsearch的普通用戶 ##### 安裝elasticsearchelasticsearch wget https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-6.3.2.tar.gz tar -zxf elasticsearch-6.3.2.tar.gz#### 創(chuàng)建elasticsearch的普通賬號(hào) groupadd elasticsearch useradd elasticsearch -g elasticsearch chown -R elasticsearch.elasticsearch /data chown -R elasticsearch.elasticsearch /usr/local/elasticsearch-6.3.2/# 一些優(yōu)化配置 swapoff -aecho "fs.file-max = 1000000" >> /etc/sysctl.conf echo "vm.max_map_count=262144" >> /etc/sysctl.conf echo "vm.swappiness = 1" >> /etc/sysctl.conf # 讓配置生效 sysctl -p# 創(chuàng)建數(shù)據(jù)和日志目錄 mkdir -p /data/es/data mkdir -p /data/es/logses節(jié)點(diǎn)的配置：主節(jié)點(diǎn) master 配置： [root@cms_elasticsearch01 config]# cat elasticsearch.yml # 節(jié)點(diǎn)名 cluster.name: cms-uat-es # 集群的名稱，可以不寫 discovery.zen.ping.unicast.hosts: ["cms_elasticsearch01","cms_elasticsearch02"] node.name: cms_elasticsearch01 node.master: true node.data: true path.data: /data/es/data path.logs: /data/es/logs #action.auto_create_index: false indices.fielddata.cache.size: 1g # 內(nèi)網(wǎng)地址，可以加快速度 #network.host: 192.168.254.36 network.host: 0.0.0.0 http.port: 9200 # 增加新的參數(shù)head插件可以訪問(wèn)es http.cors.enabled: true http.cors.allow-origin: "*"gateway.recover_after_time: 8m# 以下配置可以減少當(dāng)es節(jié)點(diǎn)短時(shí)間宕機(jī)或重啟時(shí)shards重新分布帶來(lái)的磁盤io讀寫浪費(fèi) discovery.zen.fd.ping_timeout: 300s discovery.zen.fd.ping_retries: 8 discovery.zen.fd.ping_interval: 30s discovery.zen.ping_timeout: 180s數(shù)據(jù)節(jié)點(diǎn)配置 [root@cms_elasticsearch02 ~]# cat /usr/local/elasticsearch-6.3.2/config/elasticsearch.yml # 節(jié)點(diǎn)名 cluster.name: cms-uat-es # 集群的名稱，可以不寫 discovery.zen.ping.unicast.hosts: ["cms_elasticsearch01","cms_elasticsearch02"] node.name: cms_elasticsearch02 node.master: false node.data: true path.data: /data/es/data path.logs: /data/es/logs #action.auto_create_index: false indices.fielddata.cache.size: 1g bootstrap.memory_lock: false # 內(nèi)網(wǎng)地址，可以加快速度 #network.host: 192.168.254.37 network.host: 0.0.0.0 http.port: 9200 # 增加新的參數(shù)head插件可以訪問(wèn)es http.cors.enabled: true http.cors.allow-origin: "*"gateway.recover_after_time: 8m# 以下配置可以減少當(dāng)es節(jié)點(diǎn)短時(shí)間宕機(jī)或重啟時(shí)shards重新分布帶來(lái)的磁盤io讀寫浪費(fèi) discovery.zen.fd.ping_timeout: 300s discovery.zen.fd.ping_retries: 8 discovery.zen.fd.ping_interval: 30s discovery.zen.ping_timeout: 180s# 修改hosts文件 echo "192.168.254.36 cms_elasticsearch01" >> /etc/hosts echo "192.168.254.37 cms_elasticsearch02" >> /etc/hosts# 啟動(dòng)程序 su elasticsearch -c "cd /usr/local/elasticsearch-6.3.2 && bin/elasticsearch -d"三、添加zabbix監(jiān)控硬件資源的監(jiān)控 es的監(jiān)控# 集群狀態(tài)監(jiān)控腳本 UserParameter=es_status,curl -sXGET http://192.168.254.37:9200/_cluster/health/?pretty | grep "status"|awk -F '[ "]+' '{print $4}'|grep -c 'green' # 如果出現(xiàn)錯(cuò)誤的監(jiān)控 UserParameter=es_debug,sudo /bin/find /usr/local/elasticsearch-6.3.2 -name hs_err_pid*.log -o -name java_pid*.hprof|wc -l# 監(jiān)控觸發(fā)自動(dòng)啟動(dòng)elasticsearch腳本：# vim /usr/local/zabbix_agents_3.2.0/scripts/start_es.sh#!/bin/bash # if elasticsearch process exists kill it source /etc/profilecount_es=`ps -ef|grep elasticsearch|grep -v grep|wc -l` if [ $count_es -ge 1 ];then ps -ef|grep elasticsearch|grep -v grep|/bin/kill `awk '{print $2}'` fi rm -f /usr/local/elasticsearch-6.3.2/bin/java_pid*.hprof # start it su elasticsearch -c "cd /usr/local/elasticsearch-6.3.2 && bin/elasticsearch -d"# chmod +x /usr/local/zabbix_agents_3.2.0/scripts/start_es.sh########################################## 安裝head插件 # yum install -y epel-release # yum install -y nodejs[root@cms_elasticsearch01 elasticsearch-head]# npm install -g cnpm --registry=https://registry.npm.taobao.org npm WARN deprecated socks@1.1.10: If using 2.x branch, please upgrade to at least 2.1.6 to avoid a serious bug with socket data flow and an import issue introduced in 2.1.0 /usr/bin/cnpm -> /usr/lib/node_modules/cnpm/bin/cnpm /usr/lib └─┬ cnpm@6.0.0 ├── auto-correct@1.0.0 ├── bagpipe@0.3.5 [root@cms_elasticsearch01 elasticsearch-head]# npm install -g grunt /usr/bin/grunt -> /usr/lib/node_modules/grunt/bin/grunt /usr/lib └─┬ grunt@1.0.3 [root@cms_elasticsearch01 elasticsearch-head]# npm install -g grunt-cli --registry=https://registry.npm.taobao.org --no-proxy /usr/bin/grunt -> /usr/lib/node_modules/grunt-cli/bin/grunt /usr/lib └─┬ grunt-cli@1.3.1[root@cms_elasticsearch01 elasticsearch-head]# grunt -version grunt-cli v1.3.1（6）下載依賴進(jìn)入elasticsearch-head-master目錄，執(zhí)行下面命令 [root@cms_elasticsearch01 elasticsearch-head]# npm install(7)修改配置，當(dāng)有外網(wǎng)和內(nèi)網(wǎng)IP的時(shí)候需要修改配置elasticsearch-head/Gruntfile.js 文件connect: {server: {options: {hostname: '*',port: 9100,base: '.',keepalive: true# 修改 elasticsearch-head/_site/app.js 將localhost修改為本機(jī)外網(wǎng)ip地址 this.base_uri = this.config.base_uri || this.prefs.get("app-base_uri") || "http://70.39.189.23:9200";# 防火墻要互相放行 # 啟動(dòng)head插件 su elasticsearch -c "cd /usr/local/elasticsearch-head && nohup npm run start >> /usr/local/elasticsearch-head/logs/npm-start.log 2>&1 &"# chown -R elasticsearch.elasticsearch /usr/local/elasticsearch-head/# 啟動(dòng)head插件腳本#!/bin/sh # stop elasticsearch master function function stopelkmaster() {count=`ps -ef | grep -v grep |grep grunt | wc -l`if [ $count -gt 0 ];thenfor i in `ps -ef | grep -v grep |grep grunt|awk '{print $2}'`do#echo "is exists:"kill -9 $idonefi }# start elasticsearch master function function startelkmaster() {count=`ps -ef | grep -v grep |grep grunt | wc -l`if [ $count -gt 0 ];thenfor i in `ps -ef | grep -v grep |grep grunt|awk '{print $2}'`dokill -9 $idonesleep 1cd /opt/elasticsearch-headsu elasticsearch -c "cd /usr/local/elasticsearch-head && nohup npm run start >> /usr/local/elasticsearch-head/logs/npm-start.log 2>&1 &"elsecd /opt/elasticsearch-headsu elasticsearch -c "cd /usr/local/elasticsearch-head && nohup npm run start >> /usr/local/elasticsearch-head/logs/npm-start.log 2>&1 &"fi } isExistsElk=`ps -ef | grep -v grep |grep grunt | wc -l` if [ $isExistsElk -eq 0 ] then#echo "start process....."startelkmaster elif [ $isExistsElk -gt 0 ] thenstopelkmastersleep 1startelkmaster elseecho "error!" fi

轉(zhuǎn)載于:https://www.cnblogs.com/reblue520/p/6284395.html

總結(jié)

以上是生活随笔為你收集整理的生产环境elasticsearch5.0.1和6.3.2集群的部署配置详解的全部?jī)?nèi)容，希望文章能夠幫你解決所遇到的問(wèn)題。

如果覺得生活随笔網(wǎng)站內(nèi)容還不錯(cuò)，歡迎將生活随笔推薦給好友。

上一篇： Flow - JS静态类型检查工具
下一篇： Mac下一台电脑管理多个SSH KEY（