第二章 DMDSC集群搭建
生活随笔
收集整理的這篇文章主要介紹了
第二章 DMDSC集群搭建
小編覺得挺不錯的,現在分享給大家,幫大家做個參考.
第二章 DMDSC集群搭建
第一章 DMDSC集群介紹
文章目錄
- 第二章 DMDSC集群搭建
- 五、DMDSC部署
- 5.1集群規劃
- 5.2、存儲規劃
- 5.2.1劃分存儲(虛擬機一共分配了60G)
- 5.2.2掛存儲方法1:直接掛
- 5.2.3掛存儲方法2:多路徑綁定
- 5.3、搭建DSC
- 5.3.1創建dmdcr_cfg.ini
- 5.3.2初始化磁盤組
- 5.3.3創建dmasvrmal.ini
- 5.3.4創建dmdcr.ini
- 5.3.5啟動CSS、ASM服務
- 5.3.6創建DMASM磁盤組
- 5.3.7創建dminit.ini
- 5.3.8初始化實例
- 5.3.9創建dmarch.ini
- 5.3.10啟動DMSERVER服務
- 5.3.11注冊CSS、ASM、DMSERVER后臺服務
- 5.4配置監視器
- 5.4.1創建dmcssm.ini
- 5.4.2注冊服務
- 5.5啟停服務
- 5.5.1啟動監視器
- 5.5.2啟停集群
五、DMDSC部署
5.1集群規劃
服務器配置信息
5.2、存儲規劃
5.2.1劃分存儲(虛擬機一共分配了60G)
A機器:小于2TB的存儲使用fdisk命令來劃分 [root@~]# fdisk /dev/sdb1) 依次輸入 n p 1 回車 +100M,完成第一塊磁盤劃分2) 依次輸入 n p 2 回車 +100M,完成第二塊磁盤劃分3) 依次輸入 n p 3 回車 +20480M,完成第三塊磁盤劃分4) 依次輸入 n p 回車 回車 回車,完成第四塊磁盤劃分5) 輸入w命令,將裸設備劃分的設置進行保存A機器:大于2TB的需要使用parted命令來劃分 [root@~]# parted /dev/sdb1) 輸入 mklabel gpt 回車,將MBR磁盤磁盤轉換為gpt格式2) 輸入 mkpart primary 0 100 回車,完成第一塊磁盤劃分3) 輸入 mkpart primary 100 200 回車,完成第二塊磁盤劃分4) 輸入 mkpart primary 200 20680 回車,完成第三塊磁盤劃分5) 輸入 mkpart primary 20680 5498G 回車,完成第四塊磁盤劃分6) 輸入 quit 回車,完成磁盤劃分 ?A機器、B機器依次執行 [root@~]# partprobe /dev/sdb5.2.2掛存儲方法1:直接掛
A機器、B機器依次修改 [root@~]# vi /etc/udev/rules.d/70-persistent-ipoib.rulesACTION=="add", KERNEL=="sdb1", RUN+="/bin/raw /dev/raw/raw1 %N"ACTION=="add", KERNEL=="sdb2", RUN+="/bin/raw /dev/raw/raw2 %N"ACTION=="add", KERNEL=="sdb3", RUN+="/bin/raw /dev/raw/raw3 %N"ACTION=="add", KERNEL=="sdb4", RUN+="/bin/raw /dev/raw/raw4 %N"ACTION=="add", KERNEL=="raw[1-4]", OWNER="dmdba", GROUP="dinstall", MODE="660" [root@~]# partprobe /dev/sdb [root@~]# reboot 注意:可通過blockdev --getsize64 /dev/raw/raw*命令查看設備大小。5.2.3掛存儲方法2:多路徑綁定
使用命令ll /dev/mappr和ll /dev/dm*查看對應設備的信息 例如,/dev/mapper/mpathg1對應dm-3,主設備編號為253,次設備編號為3A機器、B機器依次修改 [root@~]# vi /etc/udev/rules.d/70-persistent-ipoib.rulesACTION=="add",ENV{MAJOR}=="253",ENV{MINOR}=="3",RUN+="/bin/raw /dev/raw/raw1 %M %m"ACTION=="add",ENV{MAJOR}=="253",ENV{MINOR}=="4",RUN+="/bin/raw /dev/raw/raw2 %M %m"ACTION=="add",ENV{MAJOR}=="253",ENV{MINOR}=="5",RUN+="/bin/raw /dev/raw/raw3 %M %m"ACTION=="add",ENV{MAJOR}=="253",ENV{MINOR}=="6",RUN+="/bin/raw /dev/raw/raw4 %M %m"ACTION=="add",KERNEL=="raw[1-4]",OWNER="dmdba",GROUP="dinstall",MODE="660" [root@~]# partprobe /dev/mapper/mpathg [root@~]# reboot 注意:可通過blockdev --getsize64 /dev/raw/raw*命令查看設備大小。5.3、搭建DSC
5.3.1創建dmdcr_cfg.ini
A機器、B機器配置相同 [dmdba@dmdsc01 config]$ vi dmdcr_cfg.iniDCR_N_GRP = 3 #集群環境有多少個GROUP,范圍:1~16DCR_VTD_PATH = /dev/raw/raw2 #Voting Disk PathDCR_OGUID = 45331[GRP] #新建一個GROUPDCR_GRP_TYPE = CSS #組類型(CSS/ASM/DB)DCR_GRP_NAME = GRP_CSS #組名DCR_GRP_N_EP = 2 #組內節點個數DCR_GRP_DSKCHK_CNT = 60 #磁盤心跳容錯時間,單位:秒 [GRP_CSS]DCR_EP_NAME = CSS0 #CSS節點名DCR_EP_HOST = 192.168.10.100 #心跳地址DCR_EP_PORT = 5336 #CSS端口 [GRP_CSS]DCR_EP_NAME = CSS1DCR_EP_HOST = 192.168.10.101DCR_EP_PORT = 5337[GRP]DCR_GRP_TYPE = ASMDCR_GRP_NAME = GRP_ASMDCR_GRP_N_EP = 2DCR_GRP_DSKCHK_CNT = 60 [GRP_ASM]DCR_EP_NAME = ASM0 #ASM節點名,和dmasvrmal的MAL_INST_NAME一致DCR_EP_SHM_KEY = 93360 #共享內存標識DCR_EP_SHM_SIZE = 10 #共享內存大小DCR_EP_HOST = 192.168.10.100 #心跳地址DCR_EP_PORT = 5436 #ASM端口DCR_EP_ASM_LOAD_PATH = /dev/raw [GRP_ASM]DCR_EP_NAME = ASM1DCR_EP_SHM_KEY = 93361DCR_EP_SHM_SIZE = 10DCR_EP_HOST = 192.168.10.101DCR_EP_PORT = 5437DCR_EP_ASM_LOAD_PATH = /dev/raw[GRP]DCR_GRP_TYPE = DBDCR_GRP_NAME = GRP_DSCDCR_GRP_N_EP = 2DCR_GRP_DSKCHK_CNT = 60 [GRP_DSC]DCR_EP_NAME = DSC0 #實例名,和dm.ini的INSTANCE_NAME一致DCR_EP_SEQNO = 0 #組內序號,不能重復DCR_EP_PORT = 5236 #實例端口,和dm.ini的PORT_NUM一致DCR_CHECK_PORT = 5536 #DCR檢查端口 [GRP_DSC]DCR_EP_NAME = DSC1DCR_EP_SEQNO = 1DCR_EP_PORT = 5236DCR_CHECK_PORT = 55375.3.2初始化磁盤組
A機器 [dmdba@dmdsc01 bin]$ ./dmasmcmd DMASMCMD V8 ASM> ASM>create dcrdisk '/dev/raw/raw1' 'dcr' [Trace]The ASM initialize dcrdisk /dev/raw/raw1 to name DMASMdcr Used time: 49.881(ms). ASM>create votedisk '/dev/raw/raw2' 'vote' [Trace]The ASM initialize votedisk /dev/raw/raw2 to name DMASMvote Used time: 11.775(ms). ASM>create asmdisk '/dev/raw/raw3' 'LOG0' [Trace]The ASM initialize asmdisk /dev/raw/raw3 to name DMASMLOG0 Used time: 16.099(ms). ASM>create asmdisk '/dev/raw/raw4' 'DATA0' [Trace]The ASM initialize asmdisk /dev/raw/raw4 to name DMASMDATA0 Used time: 1.568(ms). ASM> ASM>init dcrdisk '/dev/raw/raw1' from '/dm8/dsc/config/dmdcr_cfg.ini' identified by 'admin1234' [Trace]DG 126 alloc one extent for inodes, addr(disk_id, disk_auno, extent_no):(0,0,1). [Trace]DG 126 allocate 4 extents for file 0xfe000002. [Trace]DG 126 alloc 4 extents for 0xfe000002, addr(disk_id, disk_auno, extent_no):(0, 0, 2)->(0, 0, 5), need_init = 1. Used time: 107.381(ms). ASM>init votedisk '/dev/raw/raw2' from '/dm8/dsc/config/dmdcr_cfg.ini' [Trace]DG 125 alloc one extent for inodes, addr(disk_id, disk_auno, extent_no):(0,0,1). [Trace]DG 125 allocate 4 extents for file 0xfd000002. [Trace]DG 125 alloc 4 extents for 0xfd000002, addr(disk_id, disk_auno, extent_no):(0, 0, 2)->(0, 0, 5), need_init = 1. Used time: 61.020(ms).5.3.3創建dmasvrmal.ini
A機器、B機器配置相同 [dmdba@dmdsc01 config]$ vi dmasvrmal.ini [MAL_INST1]MAL_INST_NAME = ASM0MAL_HOST = 192.168.10.100 #心跳地址MAL_PORT = 5636 #MAL監聽端口 [MAL_INST2]MAL_INST_NAME = ASM1MAL_HOST = 192.168.10.101MAL_PORT = 56375.3.4創建dmdcr.ini
A機器 [dmdba@dmdsc01 config]$ vi dmdcr.ini DMDCR_PATH = /dev/raw/raw1 DMDCR_MAL_PATH = /dm8/dsc/config/dmasvrmal.ini DMDCR_SEQNO = 0 DMDCR_AUTO_OPEN_CHECK = 90#DMDCR_ASM_RESTART_INTERVAL = 30 #CSS認定ASM故障重啟的時間 #DMDCR_ASM_STARTUP_CMD = /dm8/bin/dmasmsvr dcr_ini=/dm8/dsc/config/dmdcr.ini#DMDCR_DB_RESTART_INTERVAL = 60 #CSS認定DSC故障重啟的時間 #DMDCR_DB_STARTUP_CMD = /dm8/bin/dmserver path=/dm8/dsc/config/dsc0_config/dm.ini dcr_ini=/dm8/dsc/config/dmdcr.ini B機器 [dmdba@dmdsc02 config]$ vi dmdcr.ini DMDCR_PATH = /dev/raw/raw1 DMDCR_MAL_PATH = /dm8/dsc/config/dmasvrmal.ini DMDCR_SEQNO = 1 DMDCR_AUTO_OPEN_CHECK = 90#DMDCR_ASM_RESTART_INTERVAL = 30 #CSS認定ASM故障重啟的時間 #DMDCR_ASM_STARTUP_CMD = /dm8/bin/dmasmsvr dcr_ini=/dm8/dsc/config/dmdcr.ini#DMDCR_DB_RESTART_INTERVAL = 60 #CSS認定DSC故障重啟的時間 #DMDCR_DB_STARTUP_CMD = /dm8/bin/dmserver path=/dm8/dsc/config/dsc1_config/dm.ini dcr_ini=/dm8/dsc/config/dmdcr.ini 注意:當前為手動拉起A機器和B機器的ASM和DMSERVER服務。待集群配置完成后,再修改為自動拉起(刪除dmdcr.ini中紅色井號)。5.3.5啟動CSS、ASM服務
A機器、B機器依次執行 [dmdba@dmdsc01 bin]$ dmcss DCR_INI=/dm8/dsc/config/dmdcr.ini DMCSS V8 DMCSS IS READY[2022-06-07 11:03:31:375] [CSS]: 設置EP CSS0[0]為控制節點--B機器 [dmdba@dmdsc02 bin]$ dmcss DCR_INI=/dm8/dsc/config/dmdcr.ini DMCSS V8 DMCSS IS READY[2022-06-07 11:04:46:401] [CSS]: 設置EP CSS0[0]為控制節點A機器、B機器依次執行 [dmdba@dmdsc01 bin]$ dmasmsvr DCR_INI=/dm8/dsc/config/dmdcr.iniASM SELF EPNO:0 DMASMSVR V8 dmasmsvr task worker thread startup the ASM server is Ready.--B機器 [dmdba@dmdsc02 bin]$ dmasmsvr DCR_INI=/dm8/dsc/config/dmdcr.iniASM SELF EPNO:1 DMASMSVR V8 dmasmsvr task worker thread startup the ASM server is Ready.5.3.6創建DMASM磁盤組
A機器 [dmdba@dmdsc01 bin]$ dmasmtool DCR_INI=/dm8/dsc/config/dmdcr.iniASM> create diskgroup 'DMLOG' asmdisk '/dev/raw/raw3'ASM> create diskgroup 'DMDATA' asmdisk '/dev/raw/raw4'日志信息: ASM Control Node EPNO:0 check css cmd: EP OPEN, cmd_seq: 12 check css cmd: EP REAL OPEN, cmd_seq: 15 [Trace]atsk_process_connect client is local(1) [Trace]atsk_process_connect success, client_is_local=1 [Trace]Pre-check asmdisk /dev/raw/raw3 [Trace]asvr2_sync_disk_pre_check code:0 [Trace]asm_disk_add: /dev/raw/raw3 [Trace]Create diskgroup DMLOG, with asmdisk /dev/raw/raw3 [Trace]DG 0 alloc one extent for inodes, addr(disk_id, disk_auno, extent_no):(0,0,1). [Trace]aptx op_type 1, log_len 1170, start seq 0 [Trace]generate one rpag seq 0. [Trace]generate one rpag seq 1. [Trace]generate one rpag seq 2. [Trace]aptx flush op_type 1, log_len 1170, start seq 3 [Trace]The disk metadata addr(0, 0) flush. [Trace]Pre-check asmdisk /dev/raw/raw4 [Trace]asvr2_sync_disk_pre_check code:0 [Trace]aptx op_type 1, log_len 15, start seq 3 [Trace]generate one rpag seq 3. [Trace]aptx flush op_type 1, log_len 15, start seq 4 [Trace]asm_disk_add: /dev/raw/raw4 [Trace]Create diskgroup DMDATA, with asmdisk /dev/raw/raw4 [Trace]DG 1 alloc one extent for inodes, addr(disk_id, disk_auno, extent_no):(0,0,1). [Trace]aptx op_type 1, log_len 1171, start seq 0 [Trace]generate one rpag seq 0. [Trace]generate one rpag seq 1. [Trace]generate one rpag seq 2. [Trace]aptx flush op_type 1, log_len 1171, start seq 3 [Trace]The disk metadata addr(1, 0) flush.5.3.7創建dminit.ini
A機器、B機器配置相同 [dmdba@dmdsc01 config]$ vi dminit.inidb_name = dscsystem_path = +DMDATA/datamain = +DMDATA/data/dsc/main.dbfmain_size = 128roll = +DMDATA/data/dsc/roll.dbfroll_size = 128system = +DMDATA/data/dsc/system.dbfsystem_size = 128ctl_path = +DMDATA/data/dsc/dm.ctlctl_size = 8log_size = 2048dcr_path = /dev/raw/raw1dcr_seqno = 0auto_overwrite = 1PAGE_SIZE = 32CASE_SENSITIVE = YCHARSET = 0[DSC0]config_path = /dm8/dsc/config/dsc0_configport_num = 5236mal_host = 192.168.10.100mal_port = 5736log_path = +DMLOG/log/dsc0_log01.loglog_path = +DMLOG/log/dsc0_log02.log [DSC1]config_path = /dm8/dsc/config/dsc1_configport_num = 5236mal_host = 192.168.10.101mal_port = 5737log_path = +DMLOG/log/dsc1_log01.loglog_path = +DMLOG/log/dsc1_log02.log5.3.8初始化實例
A機器 --初始化實例 [dmdba@dmdsc01 config]$ dminit control=/dm8/dsc/config/dminit.ini initdb V8 db version: 0x7000c file dm.key not found, use default license! License will expire on 2023-03-04 Normal of FAST Normal of DEFAULT Normal of RECYCLE Normal of KEEP Normal of ROLLlog file path: +DMLOG/log/dsc0_log01.loglog file path: +DMLOG/log/dsc0_log02.loglog file path: +DMLOG/log/dsc1_log01.loglog file path: +DMLOG/log/dsc1_log02.logwrite to dir [+DMDATA/data/dsc]. create dm database success. 2022-06-07 11:13:32--拷貝文件到B機器 [dmdba@dmdsc01 config]$ scp -r /dm8/dsc/config/dsc1_config dmdba@192.168.10.101:/dm8/dsc/config/5.3.9創建dmarch.ini
A機器 --修改dm.ini [dmdba@dmdsc01 config]$ vi /dm8/dsc/config/dsc0_config/dm.iniARCH_INI = 1--創建dmarch.ini [dmdba@dmdsc01 config]$ vi /dm8/dsc/config/dsc0_config/dmarch.ini [ARCHIVE_LOCAL]ARCH_TYPE = LOCALARCH_DEST = /dm8/dsc/arch_0ARCH_FILE_SIZE = 1024ARCH_SPACE_LIMIT = 51200 [ARCHIVE_REMOTE]ARCH_TYPE = REMOTEARCH_DEST = DSC1ARCH_INCOMING_PATH = /dm8/dsc/arch_0_remoteARCH_FILE_SIZE = 1024ARCH_SPACE_LIMIT = 51200 B機器 --修改dm.ini [dmdba@dmdsc02 config]$ vi /dm8/dsc/config/dsc1_config/dm.iniARCH_INI = 1--創建dmarch.ini [dmdba@dmdsc02 config]$ vi /dm8/dsc/config/dsc1_config/dmarch.ini [ARCHIVE_LOCAL]ARCH_TYPE = LOCALARCH_DEST = /dm8/dsc/arch_1ARCH_FILE_SIZE = 1024ARCH_SPACE_LIMIT = 51200 [ARCHIVE_REMOTE]ARCH_TYPE = REMOTEARCH_DEST = DSC0ARCH_INCOMING_PATH = /dm8/dsc/arch_1_remoteARCH_FILE_SIZE = 1024ARCH_SPACE_LIMIT = 512005.3.10啟動DMSERVER服務
A機器 [dmdba@dmdsc01 bin]$ dmserver /dm8/dsc/config/dsc0_config/dm.ini dcr_ini=/dm8/dsc/config/dmdcr.iniB機器 [dmdba@dmdsc02 bin]$ dmserver /dm8/dsc/config/dsc1_config/dm.ini dcr_ini=/dm8/dsc/config/dmdcr.ini5.3.11注冊CSS、ASM、DMSERVER后臺服務
A機器 [root@dmdsc01 root]# ./dm_service_installer.sh -t dmcss -dcr_ini /dm8/dsc/config/dmdcr.ini -p CSS Created symlink from /etc/systemd/system/multi-user.target.wants/DmCSSServiceCSS.service to /usr/lib/systemd/system/DmCSSServiceCSS.service. 創建服務(DmCSSServiceCSS)完成[root@dmdsc01 root]# ./dm_service_installer.sh -t dmasmsvr -dcr_ini /dm8/dsc/config/dmdcr.ini -y DmCSSServiceCSS.service -p ASM Created symlink from /etc/systemd/system/multi-user.target.wants/DmASMSvrServiceASM.service to /usr/lib/systemd/system/DmASMSvrServiceASM.service. 創建服務(DmASMSvrServiceASM)完成[root@dmdsc01 root]# ./dm_service_installer.sh -t dmserver -dm_ini /dm8/dsc/config/dsc0_config/dm.ini -dcr_ini /dm8/dsc/config/dmdcr.ini -y DmASMSvrServiceASM.service -p DSC Created symlink from /etc/systemd/system/multi-user.target.wants/DmServiceDSC.service to /usr/lib/systemd/system/DmServiceDSC.service. 創建服務(DmServiceDSC)完成 [root@dmdsc01 root]# B機器 [root@dmdsc02 root]# ./dm_service_installer.sh -t dmcss -dcr_ini /dm8/dsc/config/dmdcr.ini -p CSS Created symlink from /etc/systemd/system/multi-user.target.wants/DmCSSServiceCSS.service to /usr/lib/systemd/system/DmCSSServiceCSS.service. 創建服務(DmCSSServiceCSS)完成[root@dmdsc02 root]# ./dm_service_installer.sh -t dmasmsvr -dcr_ini /dm8/dsc/config/dmdcr.ini -y DmCSSServiceCSS.service -p ASM Created symlink from /etc/systemd/system/multi-user.target.wants/DmASMSvrServiceASM.service to /usr/lib/systemd/system/DmASMSvrServiceASM.service. 創建服務(DmASMSvrServiceASM)完成[root@dmdsc02 root]# ./dm_service_installer.sh -t dmserver -dm_ini /dm8/dsc/config/dsc1_config/dm.ini -dcr_ini /dm8/dsc/config/dmdcr.ini -y DmASMSvrServiceASM.service -p DSC Created symlink from /etc/systemd/system/multi-user.target.wants/DmServiceDSC.service to /usr/lib/systemd/system/DmServiceDSC.service. 創建服務(DmServiceDSC)完成 [root@dmdsc02 root]# 備注:刪除自啟 [root@dmdsc01 root]# ./dm_service_uninstaller.sh -n DmCSSServiceCSS [root@dmdsc01 root]# ./dm_service_uninstaller.sh -n DmASMSvrServiceASM [root@dmdsc01 root]# ./dm_service_uninstaller.sh -n DmServiceDSC5.4配置監視器
5.4.1創建dmcssm.ini
A機器、B機器配置相同 [dmdba@dmdsc01 bin]$ vi dmcssm.ini CSSM_OGUID = 45331 CSSM_CSS_IP = 192.168.10.100:5336 CSSM_CSS_IP = 192.168.10.101:5337 CSSM_LOG_PATH = ../log CSSM_LOG_FILE_SIZE = 512 CSSM_LOG_SPACE_LIMIT = 20485.4.2注冊服務
[dmdba@dmdsc01 bin]$./dm_service_installer.sh -t dmcssm -cssm_ini /dm8/bin/dmcssm.ini -p Monitor 備注:刪除自啟 [dmdba@dmdsc01 bin]$./dm_service_uninstaller.sh -n DmCSSMonitorServiceMonitor5.5啟停服務
5.5.1啟動監視器
[dmdba@dmdsc01 bin]$ DmCSSMonitorServiceMonitor start 前臺啟動:[dmdba@dmdsc01 bin]$ dmcssm ini_path=/dm8/bin/dmcssm.ini [monitor] 2022-06-07 12:43:23: CSS MONITOR V8 [monitor] 2022-06-07 12:43:24: CSS MONITOR SYSTEM IS READY.[monitor] 2022-06-07 12:43:24: Wait CSS Control Node choosed... [monitor] 2022-06-07 12:43:25: Wait CSS Control Node choosed succeed.5.5.2啟停集群
啟動:A/B機器CSS A/B機器:[dmdba@dmdsc01 bin]$ /opt/dsc/dmdbms/bin/DmCSSServiceCSS start 說明:CSS啟動后30秒自動拉起ASM,60秒自動拉起DMSERVER。停止: A/B機器DMSERVER→A/B機器ASM→A/B機器CSS A/B機器:[dmdba@dmdsc01 bin]$ DmServiceDSC stop A/B機器:[dmdba@dmdsc01 bin]$ DmASMSvrServiceASM stop A/B機器:[dmdba@dmdsc01 bin]$ DmCSSServiceCSS stop 說明: (1)、DSC正常停庫必須2節點同時停止,根據目前腳本配置,CSS啟動后30秒自動拉起ASM,60秒自動拉起DMSERVER,所以停止DMSERVER和ASM后,要盡快停止CSS,避免被自動拉起。 (2)、ASM服務在任意節點停止,2個節點的ASM服務都會停止,為了保險起見,可以兩邊都執行停止命令。 (3)、服務全部停止后,要檢查后臺進程是否全部停止。社區地址:https://eco.dameng.com
總結
以上是生活随笔為你收集整理的第二章 DMDSC集群搭建的全部內容,希望文章能夠幫你解決所遇到的問題。
- 上一篇: 微软 Windows 10 1909 十
- 下一篇: layui表头跟随滚动条滑动_侧边栏实现