當前位置：首頁 > 人文社科 > 生活经验 >内容正文

生活经验

docker 实现redis集群搭建

發布時間：2023/11/28 生活经验 28 豆豆

生活随笔收集整理的這篇文章主要介紹了 docker 实现redis集群搭建小編覺得挺不錯的,現在分享給大家,幫大家做個參考.

摘要：接觸docker以來，似乎養成了一種習慣，安裝什么應用軟件都想往docker方向做，今天就想來嘗試下使用docker搭建redis集群。

首先，我們需要理論知識：Redis Cluster是Redis的分布式解決方案，它解決了redis單機中心化的問題，分布式數據庫——首要解決把整個數據集按照分區規則映射到多個節點的問題。

這邊就需要知道分區規則——哈希分區規則。Redis Cluster?采用哈希分區規則中的虛擬槽分區。所有的鍵根據哈希函數映射到0 ～ 16383，計算公式：slot = CRC16(key)&16383。每一個節點負責維護一部分槽以及槽所映射的鍵值數據。

一、創建redis docker基礎鏡像

下載redis安裝包，使用版本為：4.0.1

1

2

3

[root@etcd1 tmp]# mkdir docker_redis_cluster

[root@etcd1 tmp]# cd docker_redis_cluster/

[root@etcd2 docker_redis_cluster]# wget http://download.redis.io/releases/redis-4.0.1.tar.gz
解壓編譯redis

1

2

3

[root@etcd1 docker_redis_cluster]# tar zxvf redis-4.0.1.tar.gz

[root@etcd1 docker_redis_cluster]# cd redis-4.0.1/

[root@etcd1 redis-4.0.1]# make

修改redis配置

1	`[root@etcd3 redis-4.0.1]# vi /tmp/docker_redis_cluster/redis-4.0.1/redis.conf`

　　
修改bind ip地址

# ~~~ WARNING ~~~ If the computer running Redis is directly exposed to the

# internet, binding to all the interfaces is dangerous and will expose the

# instance to everybody on the internet. So by default we uncomment the

# following bind directive, that will force Redis to listen only into

# the IPv4 lookback interface address (this means Redis will be able to

# accept connections only from clients running into the same computer it

# is running).

#

# IF YOU ARE SURE YOU WANT YOUR INSTANCE TO LISTEN TO ALL THE INTERFACES

# JUST COMMENT THE FOLLOWING LINE.

# ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

#bind 127.0.0.1

bind 0.0.0.0

將守護進程yes改成no

# By default Redis does not run as a daemon. Use 'yes' if you need it.

# Note that Redis will write a pid file in /var/run/redis.pid when daemonized.

daemonize no

　　
將密碼項注釋去掉，添加新密碼

# Warning: since Redis is pretty fast an outside user can try up to

# 150k passwords per second against a good box. This means that you should

# use a very strong password otherwise it will be very easy to break.

#

# requirepass foobared

　　修改為

# Warning: since Redis is pretty fast an outside user can try up to

# 150k passwords per second against a good box. This means that you should

# use a very strong password otherwise it will be very easy to break.

#

requirepass 123456

因為配置了密碼，所以，配置中另外一處主從連接也需要配置密碼

# If the master is password protected (using the "requirepass" configuration

# directive below) it is possible to tell the slave to authenticate before

# starting the replication synchronization process, otherwise the master will

# refuse the slave request.

#

# masterauth <master-password>

　　修改為

# If the master is password protected (using the "requirepass" configuration

# directive below) it is possible to tell the slave to authenticate before

# starting the replication synchronization process, otherwise the master will

# refuse the slave request.

#

# masterauth <master-password>

masterauth 123456

　　

設置日志路徑

# Specify the log file name. Also the empty string can be used to force

# Redis to log on the standard output. Note that if you use standard

# output for logging but daemonize, logs will be sent to /dev/null

logfile?"/var/log/redis/redis-server.log"

　　
配置集群相關信息，去掉配置項前面的注釋

# Normal Redis instances can't be part of a Redis Cluster; only nodes that are

# started as cluster nodes can. In order to start a Redis instance as a

# cluster node enable the cluster support uncommenting the following:

#

cluster-enabled?yes

# Every cluster node has a cluster configuration file. This file is not

# intended to be edited by hand. It is created and updated by Redis nodes.

# Every Redis Cluster node requires a different cluster configuration file.

# Make sure that instances running in the same system do not have

# overlapping cluster configuration file names.

#

cluster-config-file?nodes-6379.conf

# Cluster node timeout is the amount of milliseconds a node must be unreachable

# for it to be considered in failure state.

# Most other internal time limits are multiple of the node timeout.

#

cluster-node-timeout 15000

鏡像制作

[root@etcd3 docker_redis_cluster]# cd /tmp/docker_redis_cluster

[root@etcd3 docker_redis_cluster]# vi Dockerfile

# Redis

# Version 4.0.1

FROM Centos:7<br>

ENV REDIS_HOME?/usr/local<br>

ADD redis-4.0.1.tar.gz /?# 本地的redis源碼包復制到鏡像的根路徑下，ADD命令會在復制過后自動解包。被復制的對象必須處于Dockerfile同一路徑，且ADD后面必須使用相對路徑

RUN?mkdir?-p $REDIS_HOME/redis?# 創建安裝目錄

ADD redis-4.0.1/redis.conf $REDIS_HOME/redis/??# 將一開始編譯產生并修改后的配置復制到安裝目錄

RUN yum -y update??# 更新yum源

RUN yum?install?-y?gcc?make?# 安裝編譯需要的工具

WORKDIR?/redis-4.0.1

RUN?make

RUN?mv?/redis-4.0.1/src/redis-server??$REDIS_HOME/redis/???# 編譯后，容器中只需要可執行文件redis-server

WORKDIR /

RUN?rm?-rf?/redis-4.0.1??????????# 刪除解壓文件

RUN yum remove -y?gcc?make???# 安裝編譯完成之后，可以刪除多余的gcc跟make

VOLUME ["/var/log/redis"]??# 添加數據卷

EXPOSE 6379???# 暴露6379端口，也可以暴露多個端口，這里不需要如此

　　
PS.當前鏡像非可執行鏡像，所以沒有包含ENTRYPOINT和CMD指令

構建鏡像

# 切換中國源

[root@etcd3 docker_redis_cluster]# vi /etc/docker/daemon.json

{

??"registry-mirrors": ["https://registry.docker-cn.com"]

}

# 編譯

[root@etcd3 docker_redis_cluster]# docker build -t hakimdstx/cluster-redis .

...

Complete!

?---> 546cb1d34f35

Removing intermediate container 6b6556c5f28d

Step 14/15?: VOLUME?/var/log/redis

?---> Running?in?05a6642e4046

?---> e7e2fb8676b2

Removing intermediate container 05a6642e4046

Step 15/15?: EXPOSE 6379

?---> Running?in?5d7abe1709e2

?---> 2d1322475f79

Removing intermediate container 5d7abe1709e2

Successfully built 2d1322475f79

　　
鏡像制作完成，制作中間可能會報：?Public key?for?glibc-headers-2.17-222.el7.x86_64.rpm?is?not installed?錯誤，這時候需要在鏡像配置中添加一句命令：

...

RUN rpm --import?/etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7

RUN yum -y update??# 更新yum源

RUN yum?install?-y?gcc?make?# 安裝編譯需要的工具

查看鏡像：

[root@etcd3 docker_redis_cluster]# docker images

REPOSITORY????????????????????????????????? TAG???????????????? IMAGE ID??????????? CREATED???????????? SIZE

hakimdstx/cluster-redis?????????????????????4.0.1?????????????? 1fca5a08a4c7??????? 14 seconds ago????? 435 MB

centos????????????????????????????????????? 7?????????????????? 49f7960eb7e4??????? 2 days ago????????? 200 MB

以上，redis 基礎鏡像就制作完成了

二、制作redis節點鏡像

基于此前制作的redis基礎鏡像創建一個redis節點鏡像

[root@etcd3 tmp]# mkdir docker_redis_nodes

[root@etcd3 tmp]# cd docker_redis_nodes

[root@etcd3 docker_redis_nodes]# vi Dockerfile

# Redis Node

# Version 4.0.1<br>

FROM hakimdstx/cluster-redis:4.0.1

# MAINTAINER_INFO

MAINTAINER hakim 1194842583@qq.com

ENTRYPOINT ["/usr/local/redis/redis-server",?"/usr/local/redis/redis.conf"]

構建redis節點鏡像

[root@etcd3 docker_redis_nodes]# docker build -t hakimdstx/nodes-redis:4.0.1 .??????

Sending build context to Docker daemon 2.048 kB

Step 1/3?: FROM hakimdstx/cluster-redis:4.0.1

?---> 1fca5a08a4c7

Step 2/3?: MAINTAINER hakim 1194842583@qq.com

?---> Running?in?cc6e07eb2c36

?---> 55769d3bfacb

Removing intermediate container cc6e07eb2c36

Step 3/3?: ENTRYPOINT?/usr/local/redis/redis-server?/usr/local/redis/redis.conf

?---> Running?in?f5dedf88f6f6

?---> da64da483559

Removing intermediate container f5dedf88f6f6

Successfully built da64da483559

查看鏡像

[root@etcd3 docker_redis_nodes]# docker images

REPOSITORY????????????????????????????????? TAG???????????????? IMAGE ID??????????? CREATED???????????? SIZE

hakimdstx/nodes-redis???????????????????????4.0.1?????????????? da64da483559??????? 51 seconds ago????? 435 MB

hakimdstx/cluster-redis?????????????????????4.0.1?????????????? 1fca5a08a4c7??????? 9 minutes ago?????? 435 MB

centos????????????????????????????????????? 7?????????????????? 49f7960eb7e4??????? 2 days ago????????? 200 MB

三、運行redis集群

運行redis容器

[root@etcd3 docker_redis_nodes]# docker run -d --name redis-6379 -p 6379:6379 hakimdstx/nodes-redis:4.0.1??

1673a7d859ea83257d5bf14d82ebf717fb31405c185ce96a05f597d8f855aa7d

[root@etcd3 docker_redis_nodes]# docker run -d --name redis-6380 -p 6380:6379 hakimdstx/nodes-redis:4.0.1???

df6ebce6f12a6f3620d5a29adcfbfa7024e906c3af48f21fa7e1fa524a361362

[root@etcd3 docker_redis_nodes]# docker run -d --name redis-6381 -p 6381:6379 hakimdstx/nodes-redis:4.0.1??

396e174a1d9235228b3c5f0266785a12fb1ea49efc7ac755c9e7590e17aa1a79

[root@etcd3 docker_redis_nodes]# docker run -d --name redis-6382 -p 6382:6379 hakimdstx/nodes-redis:4.0.1

d9a71dd3f969094205ffa7596c4a04255575cdd3acca2d47fe8ef7171a3be528

[root@etcd3 docker_redis_nodes]# docker run -d --name redis-6383 -p 6383:6379 hakimdstx/nodes-redis:4.0.1

73e4f843d8cb28595456e21b04f97d18ce1cdf8dc56d1150844ba258a3781933

[root@etcd3 docker_redis_nodes]# docker run -d --name redis-6384 -p 6384:6379 hakimdstx/nodes-redis:4.0.1

10c62aafa4dac47220daf5bf3cec84406f086d5261599b54ec6c56bb7da97d6d

查看容器信息

[root@etcd3 redis]# docker ps

CONTAINER ID??????? IMAGE???????????????????????? COMMAND????????????????? CREATED???????????? STATUS????????????? PORTS??????????????????? NAMES

10c62aafa4da??????? hakimdstx/nodes-redis:4.0.1???"/usr/local/redis/..."???3 seconds ago?????? Up 2 seconds??????? 0.0.0.0:6384->6379/tcp???redis-6384

73e4f843d8cb??????? hakimdstx/nodes-redis:4.0.1???"/usr/local/redis/..."???12 seconds ago????? Up 10 seconds?????? 0.0.0.0:6383->6379/tcp???redis-6383

d9a71dd3f969??????? hakimdstx/nodes-redis:4.0.1???"/usr/local/redis/..."???20 seconds ago????? Up 18 seconds?????? 0.0.0.0:6382->6379/tcp???redis-6382

396e174a1d92??????? hakimdstx/nodes-redis:4.0.1???"/usr/local/redis/..."???3 days ago????????? Up 3 days?????????? 0.0.0.0:6381->6379/tcp???redis-6381

df6ebce6f12a??????? hakimdstx/nodes-redis:4.0.1???"/usr/local/redis/..."???3 days ago????????? Up 3 days?????????? 0.0.0.0:6380->6379/tcp???redis-6380

1673a7d859ea??????? hakimdstx/nodes-redis:4.0.1???"/usr/local/redis/..."???3 days ago????????? Up 3 days?????????? 0.0.0.0:6379->6379/tcp???redis-6379

運行 redis 集群容器

通過遠程連接，查看redis ?info replication?信息

[root@etcd2 ~]#? redis-cli -h 192.168.10.52 -p 6379

192.168.10.52:6379> info replication

NOAUTH Authentication required.

192.168.10.52:6379> auth 123456

OK

192.168.10.52:6379> info replication

# Replication

role:master

connected_slaves:0

master_replid:2f0a7b50aed699fa50a79f3f7f9751a070c50ee9

master_replid2:0000000000000000000000000000000000000000

master_repl_offset:0

second_repl_offset:-1

repl_backlog_active:0

repl_backlog_size:1048576

repl_backlog_first_byte_offset:0

repl_backlog_histlen:0

192.168.10.52:6379>

# 其余基本信息同上

　　可以看到，客戶連接之后，因為之前設置了密碼，所以需要先輸入密碼認證，否則就無法通過。以上信息，我們知道所有的redis都是master角色?role:master?，這顯然不是我們所希望的。

在配置之前我們需要查看所有容器當前的IP地址

[root@etcd3 redis]# docker ps

CONTAINER ID??????? IMAGE???????????????????????? COMMAND????????????????? CREATED???????????? STATUS????????????? PORTS??????????????????? NAMES

10c62aafa4da??????? hakimdstx/nodes-redis:4.0.1???"/usr/local/redis/..."???3 seconds ago?????? Up 2 seconds??????? 0.0.0.0:6384->6379/tcp???redis-6384

73e4f843d8cb??????? hakimdstx/nodes-redis:4.0.1???"/usr/local/redis/..."???12 seconds ago????? Up 10 seconds?????? 0.0.0.0:6383->6379/tcp???redis-6383

d9a71dd3f969??????? hakimdstx/nodes-redis:4.0.1???"/usr/local/redis/..."???20 seconds ago????? Up 18 seconds?????? 0.0.0.0:6382->6379/tcp???redis-6382

396e174a1d92??????? hakimdstx/nodes-redis:4.0.1???"/usr/local/redis/..."???3 days ago????????? Up 3 days?????????? 0.0.0.0:6381->6379/tcp???redis-6381

df6ebce6f12a??????? hakimdstx/nodes-redis:4.0.1???"/usr/local/redis/..."???3 days ago????????? Up 3 days?????????? 0.0.0.0:6380->6379/tcp???redis-6380

1673a7d859ea??????? hakimdstx/nodes-redis:4.0.1???"/usr/local/redis/..."???3 days ago????????? Up 3 days?????????? 0.0.0.0:6379->6379/tcp???redis-6379

[root@etcd3 redis]#

[root@etcd3 redis]# docker inspect 10c62aafa4da 73e4f843d8cb d9a71dd3f969 396e174a1d92 df6ebce6f12a 1673a7d859ea | grep IPA

????????????"SecondaryIPAddresses": null,

????????????"IPAddress":?"172.17.0.7",