1、一、网卡绑定1、修改配置文件/etc/modprobe.confalias bond0 bondingalias bond1 bonding/etc/sysconfig/network-scripts/ifcfg-bond0DEVICE=bond0BOOTPROTO=staticONBOOT=yesUSERCTL=noIPADDR=192.168.56.101BROADCAST=192.168.56.255NETWORK=192.168.56.0NETMASK=255.255.255.0TYPE=EthernetBONDING_OPTS=“mode=1 miimon=100“/etc/sysc
2、onfig/network-scripts/ifcfg-bond1DEVICE=bond1BOOTPROTO=staticONBOOT=yesUSERCTL=noIPADDR=192.168.136.101BROADCAST=192.168.136.255NETWORK=192.168.136.0NETMASK=255.255.255.0TYPE=EthernetBONDING_OPTS=“mode=1 miimon=100“/etc/sysconfig/network-scripts/ifcfg-eth0# Advanced Micro Devices AMD 79c970 PCnet32
3、LANCEDEVICE=eth0BOOTPROTO=noneONBOOT=yesUSERCTL=noHWADDR=00:0c:29:9e:87:44MASTER=bond0SLAVE=yes/etc/sysconfig/network-scripts/ifcfg-eth1# Advanced Micro Devices AMD 79c970 PCnet32 LANCEDEVICE=eth1BOOTPROTO=noneONBOOT=yesHWADDR=00:0c:29:9e:87:4eMASTER=bond0SLAVE=yes/etc/sysconfig/network-scripts/ifcf
4、g-eth2# Advanced Micro Devices AMD 79c970 PCnet32 LANCEDEVICE=eth2BOOTPROTO=noneONBOOT=yesUSERCTL=noHWADDR=00:0c:29:9e:87:58MASTER=bond1SLAVE=yes/etc/sysconfig/network-scripts/ifcfg-eth3# Advanced Micro Devices AMD 79c970 PCnet32 LANCEDEVICE=eth3BOOTPROTO=noneONBOOT=yesHWADDR=00:0c:29:9e:87:62USERCT
5、L=noMASTER=bond1SLAVE=yes命令:ifensalve bond0 eth0 eth1 ifensalve bond1 eth2 eth3service network restart2、检查配置cat /proc/net/bonding/bond0Ethernet Channel Bonding Driver: v3.6.0 (September 26, 2009)Bonding Mode: fault-tolerance (active-backup)Primary Slave: NoneCurrently Active Slave: eth0MII Status: u
6、pMII Polling Interval (ms): 100Up Delay (ms): 0Down Delay (ms): 0Slave Interface: eth0MII Status: upLink Failure Count: 0Permanent HW addr: 00:0c:29:9e:87:44Slave queue ID: 0Slave Interface: eth1MII Status: upLink Failure Count: 0Permanent HW addr: 00:0c:29:9e:87:4eSlave queue ID: 0cat /proc/net/bon
7、ding/bond1Ethernet Channel Bonding Driver: v3.6.0 (September 26, 2009)Bonding Mode: fault-tolerance (active-backup)Primary Slave: NoneCurrently Active Slave: eth2MII Status: upMII Polling Interval (ms): 100Up Delay (ms): 0Down Delay (ms): 0Slave Interface: eth2MII Status: upLink Failure Count: 0Perm
8、anent HW addr: 00:0c:29:9e:87:58Slave queue ID: 0Slave Interface: eth3MII Status: upLink Failure Count: 0Permanent HW addr: 00:0c:29:9e:87:62Slave queue ID: 03、测试自动切换在 vmware workstation界面上将相应的网卡(cat /proc/met/bonding/bondN)disconnect,依次测试。用 ifdown、ifup 方式不行不会自动切换/etc/modprobe.conf (redhat6.0+:/etc/
9、modprobe.d/dist.conf)需要添加fail_over_mac=1 = 切换的时候改 MAC地址,不加不会切换成功(virtualbox、vmware workstation下测试)二、建用户和组groupadd oinstall -g 1000groupadd dba -g 1001groupadd asmadmin -g 1101groupadd asmdba -g 1102groupadd asmoper -g 1103useradd -m -u 1001 -g oinstall -G asmadmin,asmdba,asmoper -d /home/grid gridus
10、eradd -m -u 1002 -g dba -G oinstall,asmdba,asmoper -d /home/oracle oracle三、创建磁盘ocr、data .KERNEL=“sd?“,BUS=“scsi“,PROGRAM=“/sbin/scsi_id -g -u /dev/$name“,RESULT=“36000c293bc7e9c8139a42cb118aa8913“,NAME=“asm-ocr“,OWNER=“grid“,GROUP=“asmadmin“,MODE=“0660“ RUN+=“/bin/raw /dev/raw/raw1 /dev/asm-ocr“KERN
11、EL=“sd?“,BUS=“scsi“,PROGRAM=“/sbin/scsi_id -g -u /dev/$name“,RESULT=“36000c2910f9afeae89aa3ef976f95c50“,NAME=“asm-data“,OWNER=“grid“,GROUP=“asmadmin“,MODE=“0660“ RUN+=“/bin/raw /dev/raw/raw2 /dev/asm-data“ACTION=“add“,KERNEL=“raw1“, OWNER=“grid“, GROUP=“asmadmin“, MODE=“660“ACTION=“add“,KERNEL=“raw2
12、“, OWNER=“grid“, GROUP=“asmadmin“, MODE=“660“四、安装 Grid Infrastructure这一步老是报错(报 diskgroup相关错误,忘记记录了),改成预分配 harddisk空间后成功node1:rootoel501 # /opt/grid/app/11.2.0/grid/root.sh Performing root user operation for Oracle 11g The following environment variables are set as:ORACLE_OWNER= gridORACLE_HOME= /opt
13、/grid/app/11.2.0/gridEnter the full pathname of the local bin directory: /usr/local/bin: The file “dbhome“ already exists in /usr/local/bin. Overwrite it? (y/n) n: The file “oraenv“ already exists in /usr/local/bin. Overwrite it? (y/n) n: The file “coraenv“ already exists in /usr/local/bin. Overwrit
14、e it? (y/n) n: Creating /etc/oratab file.Entries will be added to the /etc/oratab file as needed byDatabase Configuration Assistant when a database is createdFinished running generic part of root script.Now product-specific root actions will be performed.Using configuration parameter file: /opt/grid
15、/app/11.2.0/grid/crs/install/crsconfig_paramsCreating trace directoryUser ignored Prerequisites during installationOLR initialization - successfulroot walletroot wallet certroot cert exportpeer walletprofile reader walletpa walletpeer wallet keyspa wallet keyspeer cert requestpa cert requestpeer cer
16、tpa certpeer root cert TPprofile reader root cert TPpa root cert TPpeer pa cert TPpa peer cert TPprofile reader pa cert TPprofile reader peer cert TPpeer user certpa user certCRS-2728: A resource type with the name ora.daemon.type is already registeredCRS-4000: Command Add failed, or completed with
17、errors.CRS-2728: A resource type with the name ora.haip.type is already registeredCRS-4000: Command Add failed, or completed with errors.CRS-2728: A resource type with the name ora.mdns.type is already registeredCRS-4000: Command Add failed, or completed with errors.Failed to register Grid Infrastru
18、cture type ora.mdns.type at /opt/grid/app/11.2.0/grid/crs/install/crsconfig_lib.pm line 7777./opt/grid/app/11.2.0/grid/perl/bin/perl -I/opt/grid/app/11.2.0/grid/perl/lib -I/opt/grid/app/11.2.0/grid/crs/install /opt/grid/app/11.2.0/grid/crs/install/rootcrs.pl execution failedrootoel501 # /opt/grid/ap
19、p/11.2.0/grid/root.sh Performing root user operation for Oracle 11g The following environment variables are set as:ORACLE_OWNER= gridORACLE_HOME= /opt/grid/app/11.2.0/gridEnter the full pathname of the local bin directory: /usr/local/bin: The file “dbhome“ already exists in /usr/local/bin. Overwrite
20、 it? (y/n) n: The file “oraenv“ already exists in /usr/local/bin. Overwrite it? (y/n) n: The file “coraenv“ already exists in /usr/local/bin. Overwrite it? (y/n) n: Entries will be added to the /etc/oratab file as needed byDatabase Configuration Assistant when a database is createdFinished running g
21、eneric part of root script.Now product-specific root actions will be performed.Using configuration parameter file: /opt/grid/app/11.2.0/grid/crs/install/crsconfig_paramsUser ignored Prerequisites during installationCINT at /opt/grid/app/11.2.0/grid/crs/install/crsconfig_lib.pm line 1379./opt/grid/ap
22、p/11.2.0/grid/perl/bin/perl -I/opt/grid/app/11.2.0/grid/perl/lib -I/opt/grid/app/11.2.0/grid/crs/install /opt/grid/app/11.2.0/grid/crs/install/rootcrs.pl execution failedOracle root script execution aborted!rootoel501 # /opt/grid/app/11.2.0/grid/root.sh Performing root user operation for Oracle 11g
23、The following environment variables are set as:ORACLE_OWNER= gridORACLE_HOME= /opt/grid/app/11.2.0/gridEnter the full pathname of the local bin directory: /usr/local/bin: The file “dbhome“ already exists in /usr/local/bin. Overwrite it? (y/n) n: The file “oraenv“ already exists in /usr/local/bin. Ov
24、erwrite it? (y/n) n: The file “coraenv“ already exists in /usr/local/bin. Overwrite it? (y/n) n: Entries will be added to the /etc/oratab file as needed byDatabase Configuration Assistant when a database is createdFinished running generic part of root script.Now product-specific root actions will be
25、 performed.Using configuration parameter file: /opt/grid/app/11.2.0/grid/crs/install/crsconfig_paramsUser ignored Prerequisites during installationCRS-2672: Attempting to start ora.mdnsd on oel501CRS-2676: Start of ora.mdnsd on oel501 succeededCRS-2672: Attempting to start ora.gpnpd on oel501CRS-267
26、6: Start of ora.gpnpd on oel501 succeededCRS-2672: Attempting to start ora.cssdmonitor on oel501CRS-2672: Attempting to start ora.gipcd on oel501CRS-2676: Start of ora.cssdmonitor on oel501 succeededCRS-2676: Start of ora.gipcd on oel501 succeededCRS-2672: Attempting to start ora.cssd on oel501CRS-2
27、672: Attempting to start ora.diskmon on oel501CRS-2676: Start of ora.diskmon on oel501 succeededCRS-2676: Start of ora.cssd on oel501 succeededASM created and started successfully.Disk Group OCR created successfully.clscfg: -install mode specifiedSuccessfully accumulated necessary OCR keys.Creating
28、OCR keys for user root, privgrp rootOperation successful.CRS-4256: Updating the profileSuccessful addition of voting disk 71e7f2f09e7d4f1bbfa5e6eebf203d8f.Successfully replaced voting disk group with +OCR.CRS-4256: Updating the profileCRS-4266: Voting file(s) successfully replaced# STATE File Univer
29、sal Id File Name Disk group- - - - -1. ONLINE 71e7f2f09e7d4f1bbfa5e6eebf203d8f (/dev/raw/raw1) OCRLocated 1 voting disk(s).CRS-2672: Attempting to start ora.asm on oel501CRS-2676: Start of ora.asm on oel501 succeededCRS-2672: Attempting to start ora.OCR.dg on oel501CRS-2676: Start of ora.OCR.dg on o
30、el501 succeededConfigure Oracle Grid Infrastructure for a Cluster . succeedednode2:rootoel502 # /opt/grid/app/oraInventory/orainstRoot.shrootoel502 # /opt/grid/app/11.2.0/grid/root.sh Performing root user operation for Oracle 11g The following environment variables are set as:ORACLE_OWNER= gridORACL
31、E_HOME= /opt/grid/app/11.2.0/gridEnter the full pathname of the local bin directory: /usr/local/bin: The file “dbhome“ already exists in /usr/local/bin. Overwrite it? (y/n) n: The file “oraenv“ already exists in /usr/local/bin. Overwrite it? (y/n) n: The file “coraenv“ already exists in /usr/local/b
32、in. Overwrite it? (y/n) n: Creating /etc/oratab file.Entries will be added to the /etc/oratab file as needed byDatabase Configuration Assistant when a database is createdFinished running generic part of root script.Now product-specific root actions will be performed.Using configuration parameter fil
33、e: /opt/grid/app/11.2.0/grid/crs/install/crsconfig_paramsCreating trace directoryUser ignored Prerequisites during installationOLR initialization - successfulCRS-2728: A resource type with the name ora.daemon.type is already registeredCRS-4000: Command Add failed, or completed with errors.CRS-2728:
34、A resource type with the name ora.haip.type is already registeredCRS-4000: Command Add failed, or completed with errors.CRS-2728: A resource type with the name ora.mdns.type is already registeredCRS-4000: Command Add failed, or completed with errors.Failed to register Grid Infrastructure type ora.md
35、ns.type at /opt/grid/app/11.2.0/grid/crs/install/crsconfig_lib.pm line 7777./opt/grid/app/11.2.0/grid/perl/bin/perl -I/opt/grid/app/11.2.0/grid/perl/lib -I/opt/grid/app/11.2.0/grid/crs/install /opt/grid/app/11.2.0/grid/crs/install/rootcrs.pl execution failedrootoel502 # /opt/grid/app/11.2.0/grid/roo
36、t.sh Performing root user operation for Oracle 11g The following environment variables are set as:ORACLE_OWNER= gridORACLE_HOME= /opt/grid/app/11.2.0/gridEnter the full pathname of the local bin directory: /usr/local/bin: The file “dbhome“ already exists in /usr/local/bin. Overwrite it? (y/n) n: The
37、 file “oraenv“ already exists in /usr/local/bin. Overwrite it? (y/n) n: The file “coraenv“ already exists in /usr/local/bin. Overwrite it? (y/n) n: Entries will be added to the /etc/oratab file as needed byDatabase Configuration Assistant when a database is createdFinished running generic part of ro
38、ot script.Now product-specific root actions will be performed.Using configuration parameter file: /opt/grid/app/11.2.0/grid/crs/install/crsconfig_paramsUser ignored Prerequisites during installationCRS-2672: Attempting to start ora.mdnsd on oel502CRS-2676: Start of ora.mdnsd on oel502 succeededCRS-2
39、672: Attempting to start ora.gpnpd on oel502CRS-2676: Start of ora.gpnpd on oel502 succeededCRS-2672: Attempting to start ora.cssdmonitor on oel502CRS-2672: Attempting to start ora.gipcd on oel502CRS-2676: Start of ora.gipcd on oel502 succeededCRS-2676: Start of ora.cssdmonitor on oel502 succeededCR
40、S-2672: Attempting to start ora.cssd on oel502CRS-2672: Attempting to start ora.diskmon on oel502CRS-2676: Start of ora.diskmon on oel502 succeededCRS-2674: Start of ora.cssd on oel502 failedCRS-2679: Attempting to clean ora.cssd on oel502CRS-2681: Clean of ora.cssd on oel502 succeededCRS-2673: Atte
41、mpting to stop ora.gipcd on oel502CRS-2677: Stop of ora.gipcd on oel502 succeededCRS-2673: Attempting to stop ora.cssdmonitor on oel502CRS-2677: Stop of ora.cssdmonitor on oel502 succeededCRS-2673: Attempting to stop ora.gpnpd on oel502CRS-2677: Stop of ora.gpnpd on oel502 succeededCRS-2673: Attempt
42、ing to stop ora.mdnsd on oel502CRS-2677: Stop of ora.mdnsd on oel502 succeededCRS-4000: Command Start failed, or completed with errors.CSS startup failed with return code 1The exlusive mode cluster start failed, see Grid Infrastructure alert log for more informationInitial cluster configuration fail
43、ed. See /opt/grid/app/11.2.0/grid/cfgtoollogs/crsconfig/rootcrs_oel502.log for details/opt/grid/app/11.2.0/grid/perl/bin/perl -I/opt/grid/app/11.2.0/grid/perl/lib -I/opt/grid/app/11.2.0/grid/crs/install /opt/grid/app/11.2.0/grid/crs/install/rootcrs.pl execution failedrootoel502 # /opt/grid/app/11.2.
44、0/grid/root.sh Performing root user operation for Oracle 11g The following environment variables are set as:ORACLE_OWNER= gridORACLE_HOME= /opt/grid/app/11.2.0/gridEnter the full pathname of the local bin directory: /usr/local/bin: The file “dbhome“ already exists in /usr/local/bin. Overwrite it? (y
45、/n) n: The file “oraenv“ already exists in /usr/local/bin. Overwrite it? (y/n) n: The file “coraenv“ already exists in /usr/local/bin. Overwrite it? (y/n) n: Entries will be added to the /etc/oratab file as needed byDatabase Configuration Assistant when a database is createdFinished running generic
46、part of root script.Now product-specific root actions will be performed.Using configuration parameter file: /opt/grid/app/11.2.0/grid/crs/install/crsconfig_paramsUser ignored Prerequisites during installationCRS-4402: The CSS daemon was started in exclusive mode but found an active CSS daemon on nod
47、e oel501, number 1, and is terminatingAn active cluster was found during exclusive startup, restarting to join the clusterrootoel502 grid# /opt/grid/app/11.2.0/grid/crs/install/rootcrs.pl -verbose -deconfig -forceUsing configuration parameter file: /opt/grid/app/11.2.0/grid/crs/install/crsconfig_par
48、amsNetwork exists: 1/192.168.56.0/255.255.255.0/bond1, type staticVIP exists: /oel501-vip/192.168.56.201/192.168.56.0/255.255.255.0/bond1, hosting node oel501GSD existsONS exists: Local port 6100, remote port 6200, EM port 2016PRKO-2439 : VIP does not exist.PRKO-2313 : VIP oel502 does not exist.CLSU-00100: Operating System function: failed failed with error data: 2CLSU-00101: Operating System error message: No such file or directoryCLSU-00103: error location: scrsearch3CLSU-00104: additional error information: id doesnt exist scls_scr_setvalCRS-2791: Starting s