1、Oracle 11g RAC 在 CentOS 5.5 的安装日志 (2011-12-27 13:16)标签: 服务器 光纤 Oracle 存储器 Linux 分类： oracle 集群Oracle 11g RAC 在 CentOS 5.5 的安装日志日期：2011-08-07 来源：Linux 社区 作者：miyatang服务器 DELL R410 2台CPU INTER E5620 .4GHz 12M4CMEM 64GDISK 300G存储器DS3512DISK 600G*12 RAID5（因为 JS以次充好，在服务器光纤卡上，搞了一个月，才把问题解决掉。出现问题：1.服务器时不时找不到存
2、储器；2.在存储器设置端，找不到光纤卡接口。3.服务器重启后，找不到存储器，要存储器重启后才可找到最后还是用一块 4GB的当了 8GB给了我们。速度肯定是打折了。那个气呀。使用不同的硬件产品，就是麻烦）软件环境：CentOS 5.5 64bitOracle Database 11g Enterprise Edition Release 11.2.0.1.0（64 位）1、服务器本地磁盘分区：Disk /dev/sda: 300.0 GB, 300000000000 bytes255 heads, 63 sectors/track, 36472 cylindersUnits = cylinder
3、s of 16065 * 512 = 8225280 bytesDevice Boot Start End Blocks Id System/dev/sda1 * 1 25 200781 83 Linux/dev/sda2 26 36472 292760527+ 8e Linux LVM使用了 LVM 分区，后使用卷。关于 LVM 资料如下：http:/ 规划rootrac2 app# cat /etc/hosts# Do not remove the following line, or various programs# that require network functionality
4、 will fail.127.0.0.1 localhost.localdomain localhost#:1 localhost6.localdomain6 localhost6#public ip192.168.18.101 rac1192.168.18.103 rac2#priv ip192.168.0.101 rac1-private192.168.0.103 rac2-private#vip ip192.168.18.121 rac1-vip192.168.18.123 rac2-vip#scan ip192.168.18.100 rac-scan(注意：All host names
5、 must conform to the RFC 952 standard,which permits alphanumeric characters, Host name using underscores（“_”） are not allowed.HOSTS 文件中不支持“_” 字符)3、用户/组/usr/sbin/groupadd -g 501 oinstall/usr/sbin/groupadd -g 502 dba/usr/sbin/groupadd -g 503 oper/usr/sbin/groupadd -g 504 asmadmin/usr/sbin/groupadd -g
6、505 asmoper/usr/sbin/groupadd -g 506 asmdba/usr/sbin/useradd -g oinstall -G dba,asmdba,oper oracle/usr/sbin/useradd -g oinstall -G asmadmin,asmdba,asmoper,oper,dba gridrootora1 # id oracleuid=501(oracle) gid=501(oinstall) groups=501(oinstall),502(dba),503(oper),506(asmdba)rootora1 # id griduid=502(g
7、rid) gid=501(oinstall) groups=501(oinstall),502(dba),503(oper),504(asmadmin),505(asmoper),506(asmdba)mkdir -p /opt/app/oraInventorychown -R grid:oinstall /opt/app/oraInventorychmod -R 775 /opt/app/oraInventorymkdir -p /opt/app/gridmkdir -p /opt/app/oraclechown -R grid:oinstall /opt/app/gridchown -R
8、oracle:oinstall /opt/app/oraclechmod -R 775 /opt/app/oraclechmod -R 775 /opt/app/gridpasswd gridpasswd oracle4、修改系统参数：vi /etc/security/limits.conf#ORACLE SETTINGgrid soft nproc 2047grid hard nproc 16384grid soft nofile 1024grid hard nofile 65536oracle soft nproc 2047oracle hard nproc 16384oracle sof
9、t nofile 1024oracle hard nofile 65536vi /etc/pam.d/login#ORACLE SETTINGsession required pam_limits.so# vi /etc/sysctl.conf#ORACLE SETTINGfs.aio-max-nr = 1048576fs.file-max = 6815744kernel.shmall = 2097152kernel.shmmax = 536870912kernel.shmmni = 4096kernel.sem = 250 32000 100 128net.ipv4.ip_local_por
10、t_range = 9000 65500net.core.rmem_default = 262144net.core.rmem_max = 4194304net.core.wmem_default = 262144net.core.wmem_max = 10485865、gird 时间同步所需要的设置(11gR2 新增检查项)#Network Time Protocol Setting/sbin/service ntpd stopchkconfig ntpd off#rm /etc/ntp.confmv /etc/ntp.conf /etc/ntp.conf.org选择是开启还是关闭 SELI
11、NUX的工作模式（修改这一项后最好重启一下操作系统）rootoracle # vi /etc/selinux/config# 设置 SELINUX为 disabledSELINUX=disabled6、操作系统版本：rootrac1 # lsb_release -aLSB Version: :core-3.1-amd64:core-3.1-ia32:core-3.1-noarch:graphics-3.1-amd64:graphics-3.1-ia32:graphics-3.1-noarchDistributor ID: CentOSDescription: CentOS release 5.
12、5 (Final)Release: 5.5Codename: Finalrootrac1 # uname -aLinux solr03 2.6.18-194.11.4.el5 #1 SMP Tue Sep 21 05:04:09 EDT 2010 x86_64 x86_64 x86_64 GNU/Linuxrootrac1 #7、修改系统的发行版本rootoracle # vi /etc/RedHat-release将 CentOS release 5 (Final) 修改成#CentOS release 5 (Final)Red Hat Enterprise Linux AS release
13、 5 (Nahant Update 5)（因为 oracle公司没推出 CentOS版本的 oracle）8、修改 gird、oracle 用户的.bash_profile 文件：#grid 用户配置文件 ORACLE_HOSTNAME 请自行设置TMP=/tmp; export TMPTMPDIR=$TMP; export TMPDIRORACLE_SID=+ASM1; export ORACLE_SIDORACLE_BASE=/opt/oracle; export ORACLE_BASEORACLE_HOME=/opt/oracle/product/11.2.0; export ORACL
14、E_HOMENLS_DATE_FORMAT=“yyyy-mm-dd HH24:MI:SS“; export NLS_DATE_FORMATTHREADS_FLAG=native; export THREADS_FLAGPATH=$ORACLE_HOME/bin:$PATH; export PATHTHREADS_FLAG=native; export THREADS_FLAGPATH=$ORACLE_HOME/bin:$PATH; export PATHif $USER = “oracle“ | $USER = “grid“ ; thenif $SHELL = “/bin/ksh“ ; the
15、nulimit -p 16384ulimit -n 65536elseulimit -u 16384 -n 65536fiumask 022fistty erase h #删除键可用处理#oracle用户配置文件 ORACLE_HOSTNAME 请自行设置# Oracle Settings oracleTMP=/tmp; export TMPTMPDIR=$TMP; export TMPDIRORACLE_BASE=/opt/oracle; export ORACLE_BASEORACLE_HOME=$ORACLE_BASE/product/11.2.0; export ORACLE_HOME
16、ORACLE_SID=racdb1; export ORACLE_SIDORACLE_TERM=xterm; export ORACLE_TERMPATH=/usr/sbin:$PATH; export PATHPATH=$ORACLE_HOME/bin:$PATH; export PATHLD_LIBRARY_PATH=$ORACLE_HOME/lib:/lib:/usr/lib; export LD_LIBRARY_PATHCLASSPATH=$ORACLE_HOME/JRE:$ORACLE_HOME/jlib:$ORACLE_HOME/rdbms/jlib; export CLASSPA
17、THNLS_DATE_FORMAT=“yyyy-mm-dd HH24:MI:SS“; export NLS_DATE_FORMATNLS_LANG=AMERICAN_AMERICA.ZHS16GBK;export NLS_LANGif $USER = “oracle“ | $USER = “grid“ ; thenif $SHELL = “/bin/ksh“ ; thenulimit -p 16384ulimit -n 65536elseulimit -u 16384 -n 65536fiumask 022fistty erase h #删除键可用处理8、配置信任关系设置 SSH，1).在主节
18、点 RAC1上以 grid,oracle用户身份生成用户的公匙和私匙# su - oracle$ mkdir /.ssh$ ssh-keygen -t rsa$ ssh-keygen -t dsa2).在副节点 RAC2上执行相同的操作，确保通信无阻# ping rac1-eth0# ping rac1-eth1# su - oracle$ mkdir /.ssh$ ssh-keygen -t rsa$ ssh-keygen -t dsa3).在主节点 RAC1上 oracle用户执行以下操作$ touch /.ssh/authorized_keys$ cat /.ssh/id_rsa.pub
19、 /.ssh/authorized_keys$ cat /.ssh/id_dsa.pub /.ssh/authorized_keys#将 RAC2的加入$ ssh rac2 cat /.ssh/id_rsa.pub /.ssh/authorized_keys$ ssh rac2 cat /.ssh/id_dsa.pub /.ssh/authorized_keys$ scp /.ssh/authorized_keys rac2:/.ssh/authorized_keys4).主节点 RAC1上执行检验操作$ ssh rac1 date$ ssh rac2 date$ ssh rac1-priva
20、te date$ ssh rac2-private date5).在副节点 RAC2上执行检验操作$ ssh rac1 date$ ssh rac2 date$ ssh rac1-private date$ ssh rac2-private date-9、共享磁盘规划+CRS 三个 2G的盘+DGDATA 四个 1T的盘+DGRECOVERY 两个 1T的盘硬盘分区rootrac1 init.d# fdisk /dev/sdcDevice contains neither a valid DOS partition table, nor Sun, SGI or OSF disklabelBui
21、lding a new DOS disklabel. Changes will remain in memory only,until you decide to write them. After that, of course, the previouscontent wont be recoverable.Warning: invalid flag 0x0000 of partition table 4 will be corrected by w(rite)Command (m for help): nCommand actione extendedp primary partitio
22、n (1-4)pPartition number (1-4): 1First cylinder (1-130, default 1):Using default value 1Last cylinder or +size or +sizeM or +sizeK (1-130, default 130):Using default value 130Command (m for help): wThe partition table has been altered!Calling ioctl() to re-read partition table.Syncing disks.在用 fdisk
23、 -l 就会看到新的分区 sdb1,sdc1,sdd1,sde1,sdf110、每个节点安装 ASMoracleasmlib-2.0.4-1.el5.x86_64.rpmoracleasm-2.6.18-194.el5-2.0.5-1.el5.x86_64.rpmoracleasm-support-2.1.7-1.el5.x86_64.rpm查看对应的内核，下载对应的支持包uname -r“ command on your machine to determine your kernel version. The corresponding package has the name oracl
24、easm-下载地址：http:/ oracle# rpm -ivh oracleasm-support-2.1.7-1.el5.x86_64.rpmwarning: oracleasm-support-2.1.7-1.el5.x86_64.rpm: Header V3 DSA signature: NOKEY, key ID b38a8516Preparing. # 100%1:oracleasm-support # 100%rootrac1 oracle# rpm -ivh oracleasmlib-2.0.4-1.el5.x86_64.rpm warning: oracleasmlib-2
25、.0.4-1.el5.x86_64.rpm: Header V3 DSA signature: NOKEY, key ID 1e5e0159error: Failed dependencies:oracleasm = 1.0.4 is needed by oracleasmlib-2.0.4-1.el5.x86_64rootrac1 oracle# rpm -ivh oracleasm-2.6.18-194.11.4.el5-2.0.5-1.el5.x86_64.rpm warning: oracleasm-2.6.18-194.11.4.el5-2.0.5-1.el5.x86_64.rpm:
26、 Header V3 DSA signature: NOKEY, key ID 1e5e0159Preparing. # 100%1:oracleasm-2.6.18-194.11# 100%11、每个节点配置 ASMrootrac2 init.d# ./oracleasm configureConfiguring the Oracle ASM library driver.This will configure the on-boot properties of the Oracle ASM librarydriver. The following questions will determ
27、ine whether the driver isloaded on boot and what permissions it will have. The current valueswill be shown in brackets (). Hitting without typing ananswer will keep that current value. Ctrl-C will abort.Default user to own the driver interface grid: Default group to own the driver interface asmadmin
28、: Start Oracle ASM library driver on boot (y/n) y: Scan for Oracle ASM disks on boot (y/n) y: Writing Oracle ASM library driver configuration: doneInitializing the Oracle ASMLib driver: OK Scanning the system for Oracle ASMLib disks: OK 创建 asm盘+CRS 三个 2G的盘+DGDATA 四个 1T的盘+DGRECOVERY 两个 1T的盘（以下各分区大小和实
29、际大小不同，以下内容只供借鉴）CRS1 /dev/sdk: 2147 MBCRS2 /dev/sdl: 2147 MBCRS3 /dev/sdm: 2147 MBDGDATA1 /dev/sdn: 1099.5 GBDGDATA2 /dev/sdo: 1099.5 GBDGDATA3 /dev/sdp: 1099.5 GBDGDATA4 /dev/sdq: 1099.5 GBDGRECOVERY1 /dev/sdr: 1099.5 GBDGRECOVERY2 /dev/sds: 1091.3 GBrootora2 asm# /etc/init.d/oracleasm createdisk CR
30、S1 /dev/sdb1Marking disk “CRS1“ as an ASM disk: OK rootora2 asm# /etc/init.d/oracleasm createdisk CRS2 /dev/sdc1Marking disk “CRS2“ as an ASM disk: OK rootora2 asm# /etc/init.d/oracleasm createdisk CRS3 /dev/sdd1Marking disk “CRS3“ as an ASM disk: OK rootora2 asm# /etc/init.d/oracleasm createdisk DA
31、TA1 /dev/sde1Marking disk “DATA1“ as an ASM disk: FAILEDrootora2 asm# /etc/init.d/oracleasm createdisk DATA2 /dev/sdf1Marking disk “DATA1“ as an ASM disk: OK rootora2 asm# /etc/init.d/oracleasm createdisk DATA3 /dev/sdg1Marking disk “DATA2“ as an ASM disk: OK rootora2 asm# /etc/init.d/oracleasm crea
32、tedisk DATA4 /dev/sdh1Marking disk “DATA3“ as an ASM disk: OK rootora2 asm# /etc/init.d/oracleasm createdisk RECOVERY1 /dev/sdi1Marking disk “REC1“ as an ASM disk: OK rootora2 asm# /etc/init.d/oracleasm createdisk RECOVERY2 /dev/sdj1Marking disk “REC2“ as an ASM disk: OK rootrac2 # /etc/init.d/oracleasm scandisksScanning the system for Oracle ASMLib disks: OK rootrac2 # /etc/init.d/oracleasm listdisksCRS1CRS2CRS3DATA1DATA2DATA3DATE4
