Various Timeout Settings in Cluster:
Disktimeout: Disk Latencies in seconds from node-to-Votedisk. Default Value is 200. (Disk IO)
Misscount: Network Latencies in second from node-to-node (Interconnect). Default Value is 60 Sec (Linux) and 30 Sec in Unix platform. (Network IO) Misscount < Disktimeout
IF
(Disk IO Time > Disktimeout) OR (Network IO time > Misscount)
THEN
REBOOT NODE
ELSE
DO NOT REBOOT
END IF;
crsctl get css disktimeout
crsctl get css misscount
crsctl get css reboottime
[root@node1-ser ~]# crsctl get css disktimeout
200
[root@node1-ser ~]# crsctl get css misscount
Configuration parameter misscount is not defined.
The above message indicates that the Misscount is not set manually and it is set to its default Value which is 60 seconds on Linux. It can be changed as below.
[root@node1-ser ~]# crsctl set css misscount 100
Configuration parameter misscount is now set to 100.
[root@node1-ser ~]# crsctl get css misscount
100
The below command sets the value of misscount back to its default value.
crsctl unset css misscount
[root@node1-ser ~]# crsctl unset css misscount
[root@node1-ser ~]# crsctl get css reboottime
Add/Remove OCR file in Cluster:
Adding OCR
You need to add OCR or OCR mirror file in a case where you want to move the existing OCR file location to the different devices. The below command add the OCR mirror file if OCR file already exists.
(1) Get the Current status of OCR:
[root@node1-ser ~]# ocrconfig -replace ocrmirror
[root@node1-ser ~]# ocrcheck
Status of Oracle Cluster Registry is as follows :
Version : 2
Total space (kbytes) : 262120
Used space (kbytes) : 3852
Available space (kbytes) : 258268
ID : 744414276
Device/File Name : /u02/ocfs2/ocr/OCRfile_0 <<– OCR File
Device/File integrity check succeeded
Device/File not configured <– OCR Mirror does not exist
Cluster registry integrity check succeeded
As it can be seen, there is only one OCR file but not the second file (OCR Mirror). Below command adds the second OCR file.
ocrconfig -replace ocrmirror <File name>
[root@node1-ser ~]# ocrconfig -replace ocrmirror /u02/ocfs2/ocr/OCRfile_1
[root@node1-ser ~]# ocrcheck
Status of Oracle Cluster Registry is as follows :
Version : 2
Total space (kbytes) : 262120
Used space (kbytes) : 3852
Available space (kbytes) : 258268
ID : 744414276
Device/File Name : /u02/ocfs2/ocr/OCRfile_0
Device/File integrity check succeeded
Device/File Name : /u02/ocfs2/ocr/OCRfile_1
Device/File integrity check succeeded
Cluster registry integrity check succeeded
You can have at most 2 OCR devices (OCR itself and its single Mirror) in a cluster. Adding extra Mirror gives you below error message
[root@node1-ser ~]# ocrconfig -replace ocrmirror /u02/ocfs2/ocr/OCRfile_2
PROT-21: Invalid parameter
[root@node1-ser ~]#
Removing OCR File
(1) Get the Existing OCR file information by running ocrcheck utility.
[root@node1-ser ~]# ocrcheck
Status of Oracle Cluster Registry is as follows :
Version : 2
Total space (kbytes) : 262120
Used space (kbytes) : 3852
Available space (kbytes) : 258268
ID : 744414276
Device/File Name : /u02/ocfs2/ocr/OCRfile_0 <– OCR
Device/File integrity check succeeded
Device/File Name : /u02/ocfs2/ocr/OCRfile_1 <– OCR Mirror
Device/File integrity check succeeded
Cluster registry integrity check succeeded
(2) The First command removes the OCR mirror (/u02/ocfs2/ocr/OCRfile_1). If you want to remove the OCR file (/u02/ocfs2/ocr/OCRfile_1) run the next command.
ocrconfig -replace ocrmirror
ocrconfig -replace ocr
[root@node1-ser ~]# ocrconfig -replace ocrmirror
[root@node1-ser ~]# ocrcheck
Status of Oracle Cluster Registry is as follows :
Version : 2
Total space (kbytes) : 262120
Used space (kbytes) : 3852
Available space (kbytes) : 258268
ID : 744414276
Device/File Name : /u02/ocfs2/ocr/OCRfile_0 <<– OCR File
Device/File integrity check succeeded
Device/File not configured <– OCR Mirror not existed any more
Cluster registry integrity check succeeded
Add/Remove Voting Disk in Cluster:
Adding Votedisk:
Get the existing Vote Disks associated into the cluster. To be safe, Bring crs cluster stack down on all the nodes but one on which you are going to add votedisk from.
(1) Stop CRS on all the nodes in cluster but one.
[root@node2-pub ~]# crsctl stop crs
(2) Get the list of Existing Vote Disks
crsctl query css votedisk
[root@node1-ser ~]# crsctl query css votedisk
- 0 /u02/ocfs2/vote/VDFile_0
- 0 /u02/ocfs2/vote/VDFile_1
- 0 /u02/ocfs2/vote/VDFile_2
Located 3 voting disk(s).
(3) Backup the Votedisk file
Backup the existing votedisks as below as oracle:
dd if=/u02/ocfs2/vote/VDFile_0 of=$ORACLE_BASE/bkp/vd/VDFile_0
[root@node1-ser ~]# su – oracle
[oracle@node1-pub ~]$ dd if=/u02/ocfs2/vote/VDFile_0 of=$ORACLE_BASE/bkp/vd/VDFile_0
41024+0 records in
41024+0 records out
[oracle@node1-pub ~]$
(4) Add an Extra Votedisk into the Cluster:
If it is a OCFS, then touch the file as oracle. On raw devices, initialize the raw devices using “dd” command
touch /u02/ocfs2/vote/VDFile_3 <<– as oracle
crsctl add css votedisk /u02/ocfs2/vote/VDFile_3 <<– as oracle
crsctl query css votedisks
[root@node1-ser ~]# su – oracle
[oracle@node1-pub ~]$ touch /u02/ocfs2/vote/VDFile_3
[oracle@node1-pub ~]$ crsctl add css votedisk /u02/ocfs2/vote/VDFile_3
Now formatting voting disk: /u02/ocfs2/vote/VDFile_3.
Successful addition of voting disk /u02/ocfs2/vote/VDFile_3.
(5) Confirm that the file has been added successfully:
[root@node1-ser ~]# ls -l /u02/ocfs2/vote/VDFile_3
-rw-r—– 1 oracle oinstall 21004288 Oct 6 16:31 /u02/ocfs2/vote/VDFile_3
[root@node1-ser ~]# crsctl query css votedisks
Unknown parameter: votedisks
[root@node1-ser ~]# crsctl query css votedisk
- 0 /u02/ocfs2/vote/VDFile_0
- 0 /u02/ocfs2/vote/VDFile_1
- 0 /u02/ocfs2/vote/VDFile_2
- 0 /u02/ocfs2/vote/VDFile_3
Located 4 voting disk(s).
Removing Votedisk:
Removing Votedisk from the cluster is very simple. The below command removes the given votedisk from cluster configuration.
crsctl delete css votedisk /u02/ocfs2/vote/VDFile_3
[root@node1-ser ~]# crsctl delete css votedisk /u02/ocfs2/vote/VDFile_3
Successful deletion of voting disk /u02/ocfs2/vote/VDFile_3.
[root@node1-ser ~]#
[root@node1-ser ~]# crsctl query css votedisk
- 0 /u02/ocfs2/vote/VDFile_0
- 0 /u02/ocfs2/vote/VDFile_1
- 0 /u02/ocfs2/vote/VDFile_2
Located 3 voting disk(s).
[root@node1-ser ~]#