当前位置：Gxlcms > mysql > redis集群配置与管理的详细介绍（附代码）

redis集群配置与管理的详细介绍（附代码）

时间：2021-07-01 10:21:17 帮助过：34人阅读

本篇文章给大家带来的内容是关于redis集群配置与管理的详细介绍（附代码），有一定的参考价值，有需要的朋友可以参考一下，希望对你有所帮助。

Redis在3.0版本以后开始支持集群，经过中间几个版本的不断更新优化，最新的版本集群功能已经非常完善。本文简单介绍一下Redis集群搭建的过程和配置方法，redis版本是5.0.4，操作系统是中标麒麟（和Centos内核基本一致）。

1、Redis集群原理

Redis 集群是一个提供在多个Redis间节点间共享数据的程序集，集群节点共同构建了一个去中心化的网络，集群中的每个节点拥有平等的身份，节点各自保存各自的数据和集群状态。节点之间采用Gossip协议进行通信，保证了节点状态的信息同步。

Redis 集群数据通过分区来进行管理，每个节点保存集群数据的一个子集。数据的分配采用一种叫做哈希槽(hash slot)的方式来分配，和传统的一致性哈希不太相同。Redis 集群有16384个哈希槽,每个key通过CRC16校验后对16384取模来决定放置哪个槽。

为了使在部分节点失败或者大部分节点无法通信的情况下集群仍然可用，集群使用了主从复制模型。读取数据时，根据一致性哈希算法到对应的 master 节点获取数据，如果master 挂掉之后，会启动一个对应的 salve 节点来充当 master 。

2、环境准备

这里准备在一台PC上搭建一个3主3从的redis集群。

在/opt/目录下新建一个文件夹rediscluster，用来存放集群节点目录。

然后分别新建server10、server11、server20、server21、server30、server31 6个文件夹准备6个redis节点，这些节点分别使用6379、6380、6381、6382、6383、6384端口，以server10为例配置如下：

  1. port 6379
  2. daemonize yes
  3. pidfile /var/run/redis_6379.pid
  4. cluster-enabled yes
  5. cluster-node-timeout 15000
  6. cluster-config-file  nodes-6379.conf

其他节点只需修改端口和文件名，依次按此进行配置即可，配置完成后启动这些节点。

  1. [root@localhost rediscluster]# ./server10/redis-server ./server10/redis.conf &
  2. [root@localhost rediscluster]# ./server11/redis-server ./server11/redis.conf &
  3. [root@localhost rediscluster]# ./server20/redis-server ./server20/redis.conf &
  4. [root@localhost rediscluster]# ./server21/redis-server ./server21/redis.conf &
  5. [root@localhost rediscluster]# ./server30/redis-server ./server30/redis.conf &
  6. [root@localhost rediscluster]# ./server31/redis-server ./server31/redis.conf &

查看启动状态：

  1. [root@localhost rediscluster]# ps -ef|grep redis
  2. root     11842     1  0 15:03 ?        00:00:12 ./server10/redis-server 127.0.0.1:6379 [cluster]
  3. root     11950     1  0 15:03 ?        00:00:13 ./server11/redis-server 127.0.0.1:6380 [cluster]
  4. root     12074     1  0 15:04 ?        00:00:13 ./server20/redis-server 127.0.0.1:6381 [cluster]
  5. root     12181     1  0 15:04 ?        00:00:12 ./server21/redis-server 127.0.0.1:6382 [cluster]
  6. root     12297     1  0 15:04 ?        00:00:12 ./server30/redis-server 127.0.0.1:6383 [cluster]
  7. root     12404     1  0 15:04 ?        00:00:12 ./server31/redis-server 127.0.0.1:6384 [cluster]

3、集群配置

非常简单：redis-cli --cluster create 127.0.0.1:6379 127.0.0.1:6380 127.0.0.1:6381 127.0.0.1:6382 127.0.0.1:6383 127.0.0.1:6384 --cluster -replicas 1

其中-replicas 1表示每个主节点1个从节点

  1. [root@localhost rediscluster]# ./server10/redis-cli --cluster create 127.0.0.1:6379 127.0.0.1:6380 127.0.0.1:6381 127.0.0.1:6382 127.0.0.1:6383 127.0.0.1:6384 --cluster-replicas 1
  2. >>> Performing hash slots allocation on 6 nodes...
  3. Master[0] -> Slots 0 - 5460
  4. Master[1] -> Slots 5461 - 10922
  5. Master[2] -> Slots 10923 - 16383
  6. Adding replica 127.0.0.1:6383 to 127.0.0.1:6379
  7. Adding replica 127.0.0.1:6384 to 127.0.0.1:6380
  8. Adding replica 127.0.0.1:6382 to 127.0.0.1:6381
  9. >>> Trying to optimize slaves allocation for anti-affinity
  10. [WARNING] Some slaves are in the same host as their master
  11. M: efa84a74525749b8ea20585074dda81b852e9c29 127.0.0.1:6379
  12.    slots:[0-5460] (5461 slots) master
  13. M: 63e20c75984e493892265ddd2a441c81bcdc575c 127.0.0.1:6380
  14.    slots:[5461-10922] (5462 slots) master
  15. M: d9a79ed6204e558b2fcee78ea05218b4de006acd 127.0.0.1:6381
  16.    slots:[10923-16383] (5461 slots) master
  17. S: 0469ec03b43e27dc2b7b4eb24de34e10969e3adf 127.0.0.1:6382
  18.    replicates 63e20c75984e493892265ddd2a441c81bcdc575c
  19. S: fd8ea61503e7c9b6e950894c0da41aed3ee19e7e 127.0.0.1:6383
  20.    replicates d9a79ed6204e558b2fcee78ea05218b4de006acd
  21. S: ddebc3ca467d15c7d25125e4e16bcc5576a13699 127.0.0.1:6384
  22.    replicates efa84a74525749b8ea20585074dda81b852e9c29
  23. Can I set the above configuration? (type 'yes' to accept): yes
  24. >>> Nodes configuration updated
  25. >>> Assign a different config epoch to each node
  26. >>> Sending CLUSTER MEET messages to join the cluster
  27. Waiting for the cluster to join
  28. ....
  29. >>> Performing Cluster Check (using node 127.0.0.1:6379)
  30. M: efa84a74525749b8ea20585074dda81b852e9c29 127.0.0.1:6379
  31.    slots:[0-5460] (5461 slots) master
  32. additional replica(s)
  33. M: d9a79ed6204e558b2fcee78ea05218b4de006acd 127.0.0.1:6381
  34.    slots:[10923-16383] (5461 slots) master
  35. additional replica(s)
  36. S: 0469ec03b43e27dc2b7b4eb24de34e10969e3adf 127.0.0.1:6382
  37.    slots: (0 slots) slave
  38.    replicates 63e20c75984e493892265ddd2a441c81bcdc575c
  39. S: ddebc3ca467d15c7d25125e4e16bcc5576a13699 127.0.0.1:6384
  40.    slots: (0 slots) slave
  41.    replicates efa84a74525749b8ea20585074dda81b852e9c29
  42. M: 63e20c75984e493892265ddd2a441c81bcdc575c 127.0.0.1:6380
  43.    slots:[5461-10922] (5462 slots) master
  44. additional replica(s)
  45. S: fd8ea61503e7c9b6e950894c0da41aed3ee19e7e 127.0.0.1:6383
  46.    slots: (0 slots) slave
  47.    replicates d9a79ed6204e558b2fcee78ea05218b4de006acd
  48. [OK] All nodes agree about slots configuration.
  49. >>> Check for open slots...
  50. >>> Check slots coverage...
  51. [OK] All 16384 slots covered.

创建完成，主从节点分配如下：

  1. Adding replica 127.0.0.1:6383 to 127.0.0.1:6379
  2. Adding replica 127.0.0.1:6384 to 127.0.0.1:6380
  3. Adding replica 127.0.0.1:6382 to 127.0.0.1:6381

4、集群测试

通过6379客户端连接后进行测试，发现转向了6381：

  1. [root@localhost rediscluster]# ./server10/redis-cli -h 127.0.0.1 -c -p 6379
  2. 127.0.0.1:6379> set foo bar
  3. -> Redirected to slot [12182] located at 127.0.0.1:6381
  4. OK
  5. 127.0.0.1:6381> get foo
  6. "bar"

在6381上连接测试：

  1. [root@localhost rediscluster]# ./server10/redis-cli -h 127.0.0.1 -c -p 6381
  2. 127.0.0.1:6381> get foo
  3. "bar"

结果相同，说明集群配置正常。

5、集群节点扩容

在rediscluster目录下在新增两个目录server40和server41,新增2个redis节点配置6385和6386两个端口。将6385作为新增的master节点，6386作为从节点，然后启动节点：

  1. [root@localhost server41]# ps -ef|grep redis
  2. root     11842     1  0 15:03 ?        00:00:18 ./server10/redis-server 127.0.0.1:6379 [cluster]
  3. root     11950     1  0 15:03 ?        00:00:19 ./server11/redis-server 127.0.0.1:6380 [cluster]
  4. root     12074     1  0 15:04 ?        00:00:18 ./server20/redis-server 127.0.0.1:6381 [cluster]
  5. root     12181     1  0 15:04 ?        00:00:18 ./server21/redis-server 127.0.0.1:6382 [cluster]
  6. root     12297     1  0 15:04 ?        00:00:17 ./server30/redis-server 127.0.0.1:6383 [cluster]
  7. root     12404     1  0 15:04 ?        00:00:18 ./server31/redis-server 127.0.0.1:6384 [cluster]
  8. root     30563     1  0 18:01 ?        00:00:00 ./redis-server 127.0.0.1:6385 [cluster]
  9. root     30582     1  0 18:02 ?        00:00:00 ./redis-server 127.0.0.1:6386 [cluster]

添加主节点：

  1. [root@localhost server41]# ./redis-cli --cluster add-node 127.0.0.1:6385 127.0.0.1:6379
  2. >>> Adding node 127.0.0.1:6385 to cluster 127.0.0.1:6379
  3. >>> Performing Cluster Check (using node 127.0.0.1:6379)
  4. M: efa84a74525749b8ea20585074dda81b852e9c29 127.0.0.1:6379
  5.    slots:[0-5460] (5461 slots) master
  6. additional replica(s)
  7. M: d9a79ed6204e558b2fcee78ea05218b4de006acd 127.0.0.1:6381
  8.    slots:[10923-16383] (5461 slots) master
  9. additional replica(s)
  10. S: 0469ec03b43e27dc2b7b4eb24de34e10969e3adf 127.0.0.1:6382
  11.    slots: (0 slots) slave
  12.    replicates 63e20c75984e493892265ddd2a441c81bcdc575c
  13. S: ddebc3ca467d15c7d25125e4e16bcc5576a13699 127.0.0.1:6384
  14.    slots: (0 slots) slave
  15.    replicates efa84a74525749b8ea20585074dda81b852e9c29
  16. M: 63e20c75984e493892265ddd2a441c81bcdc575c 127.0.0.1:6380
  17.    slots:[5461-10922] (5462 slots) master
  18. additional replica(s)
  19. S: fd8ea61503e7c9b6e950894c0da41aed3ee19e7e 127.0.0.1:6383
  20.    slots: (0 slots) slave
  21.    replicates d9a79ed6204e558b2fcee78ea05218b4de006acd
  22. [OK] All nodes agree about slots configuration.
  23. >>> Check for open slots...
  24. >>> Check slots coverage...
  25. [OK] All 16384 slots covered.
  26. >>> Send CLUSTER MEET to node 127.0.0.1:6385 to make it join the cluster.
  27. [OK] New node added correctly.

查看节点列表：

  1. [root@localhost server41]# ./redis-cli 
  2. 127.0.0.1:6379> cluster nodes
  3. 22e8a8e97d6f7cc7d627e577a986384d4d181a4f 127.0.0.1:6385@16385 master - 0 1555064037664 0 connected
  4. efa84a74525749b8ea20585074dda81b852e9c29 127.0.0.1:6379@16379 myself,master - 0 1555064036000 1 connected 0-5460
  5. d9a79ed6204e558b2fcee78ea05218b4de006acd 127.0.0.1:6381@16381 master - 0 1555064038666 3 connected 10923-16383
  6. 0469ec03b43e27dc2b7b4eb24de34e10969e3adf 127.0.0.1:6382@16382 slave 63e20c75984e493892265ddd2a441c81bcdc575c 0 1555064035000 4 connected
  7. ddebc3ca467d15c7d25125e4e16bcc5576a13699 127.0.0.1:6384@16384 slave efa84a74525749b8ea20585074dda81b852e9c29 0 1555064037000 6 connected
  8. 63e20c75984e493892265ddd2a441c81bcdc575c 127.0.0.1:6380@16380 master - 0 1555064037000 2 connected 5461-10922
  9. fd8ea61503e7c9b6e950894c0da41aed3ee19e7e 127.0.0.1:6383@16383 slave d9a79ed6204e558b2fcee78ea05218b4de006acd 0 1555064037000 5 connected

添加从节点：

  1. [root@localhost server41]# ./redis-cli --cluster add-node 127.0.0.1:6386 127.0.0.1:6379 --cluster-slave --cluster-master-id 22e8a8e97d6f7cc7d627e577a986384d4d181a4f
  2. >>> Adding node 127.0.0.1:6386 to cluster 127.0.0.1:6379
  3. >>> Performing Cluster Check (using node 127.0.0.1:6379)
  4. M: efa84a74525749b8ea20585074dda81b852e9c29 127.0.0.1:6379
  5.    slots:[0-5460] (5461 slots) master
  6. additional replica(s)
  7. M: 22e8a8e97d6f7cc7d627e577a986384d4d181a4f 127.0.0.1:6385
  8.    slots: (0 slots) master
  9. M: d9a79ed6204e558b2fcee78ea05218b4de006acd 127.0.0.1:6381
  10.    slots:[10923-16383] (5461 slots) master
  11. additional replica(s)
  12. S: 0469ec03b43e27dc2b7b4eb24de34e10969e3adf 127.0.0.1:6382
  13.    slots: (0 slots) slave
  14.    replicates 63e20c75984e493892265ddd2a441c81bcdc575c
  15. S: ddebc3ca467d15c7d25125e4e16bcc5576a13699 127.0.0.1:6384
  16.    slots: (0 slots) slave
  17.    replicates efa84a74525749b8ea20585074dda81b852e9c29
  18. M: 63e20c75984e493892265ddd2a441c81bcdc575c 127.0.0.1:6380
  19.    slots:[5461-10922] (5462 slots) master
  20. additional replica(s)
  21. S: fd8ea61503e7c9b6e950894c0da41aed3ee19e7e 127.0.0.1:6383
  22.    slots: (0 slots) slave
  23.    replicates d9a79ed6204e558b2fcee78ea05218b4de006acd
  24. [OK] All nodes agree about slots configuration.
  25. >>> Check for open slots...
  26. >>> Check slots coverage...
  27. [OK] All 16384 slots covered.
  28. >>> Send CLUSTER MEET to node 127.0.0.1:6386 to make it join the cluster.
  29. Waiting for the cluster to join
  30. >>> Configure node as replica of 127.0.0.1:6385.
  31. [OK] New node added correctly.

添加成功后，为新节点分配数据：

  1. [root@localhost server41]# ./redis-cli --cluster reshard 127.0.0.1:6385
  2. How many slots do you want to move (from 1 to 16384)? 1000
  3. What is the receiving node ID? 22e8a8e97d6f7cc7d627e577a986384d4d181a4f
  4. Please enter all the source node IDs.
  5.   Type 'all' to use all the nodes as source nodes for the hash slots.
  6.   Type 'done' once you entered all the source nodes IDs.
  7. Source node #1: all

这样就新增完毕了，可以通过cluster nodes命令查看一下新增后的slot分布

  1. 127.0.0.1:6379> cluster nodes
  2. 22e8a8e97d6f7cc7d627e577a986384d4d181a4f 127.0.0.1:6385@16385 master - 0 1555064706000 7 connected 0-332 5461-5794 10923-11255
  3. efa84a74525749b8ea20585074dda81b852e9c29 127.0.0.1:6379@16379 myself,master - 0 1555064707000 1 connected 333-5460
  4. d9a79ed6204e558b2fcee78ea05218b4de006acd 127.0.0.1:6381@16381 master - 0 1555064705000 3 connected 11256-16383
  5. 7c24e205301b38caa1ff3cd8b270a1ceb7249a2e 127.0.0.1:6386@16386 slave 22e8a8e97d6f7cc7d627e577a986384d4d181a4f 0 1555064705000 7 connected
  6. 0469ec03b43e27dc2b7b4eb24de34e10969e3adf 127.0.0.1:6382@16382 slave 63e20c75984e493892265ddd2a441c81bcdc575c 0 1555064707000 4 connected
  7. ddebc3ca467d15c7d25125e4e16bcc5576a13699 127.0.0.1:6384@16384 slave efa84a74525749b8ea20585074dda81b852e9c29 0 1555064707236 6 connected
  8. 63e20c75984e493892265ddd2a441c81bcdc575c 127.0.0.1:6380@16380 master - 0 1555064706000 2 connected 5795-10922
  9. fd8ea61503e7c9b6e950894c0da41aed3ee19e7e 127.0.0.1:6383@16383 slave d9a79ed6204e558b2fcee78ea05218b4de006acd 0 1555064708238 5 connected

6、集群节点缩减

缩减节点时先缩减从节点:

  1. [root@localhost server41]# ./redis-cli --cluster del-node 127.0.0.1:6386 7c24e205301b38caa1ff3cd8b270a1ceb7249a2e
  2. >>> Removing node 7c24e205301b38caa1ff3cd8b270a1ceb7249a2e from cluster 127.0.0.1:6386
  3. >>> Sending CLUSTER FORGET messages to the cluster...
  4. >>> SHUTDOWN the node.

然后进行主节点slot转移：

  1. [root@localhost server41]# ./redis-cli --cluster reshard 127.0.0.1:6385How many slots do you want to move (from 1 to 16384)? 1000What is the receiving node ID? efa84a74525749b8ea20585074dda81b852e9c29  //要移到的节点Please enter all the source node IDs.
  2.   Type 'all' to use all the nodes as source nodes for the hash slots.
  3.   Type 'done' once you entered all the source nodes IDs.
  4. Source node #1: 22e8a8e97d6f7cc7d627e577a986384d4d181a4f   //要删除的主节点Source node #2: done

最后在缩减主节点

  1. [root@localhost server41]# ./redis-cli --cluster reshard 127.0.0.1:6385
  2. How many slots do you want to move (from 1 to 16384)? 1000
  3. What is the receiving node ID? efa84a74525749b8ea20585074dda81b852e9c29  //要移到的节点
  4. Please enter all the source node IDs.
  5.   Type 'all' to use all the nodes as source nodes for the hash slots.
  6.   Type 'done' once you entered all the source nodes IDs.
  7. Source node #1: 22e8a8e97d6f7cc7d627e577a986384d4d181a4f   //要删除的主节点
  8. Source node #2: done

缩减完成！【相关推荐：Redis教程】

以上就是redis集群配置与管理的详细介绍（附代码）的详细内容，更多请关注Gxl网其它相关文章！

人气教程排行

本站所有资源全部来源于网络，若本站发布的内容侵害到您的隐私或者利益，请联系我们删除！