1、Error! No text of specified style in document. 1sIN (Intelligent Networks)Routine Check ListVersion 2.12Author: Wang Dong XiaoTel: 13916597332Error! No text of specified style in document. 2In addition to the authors named on the cover page the following persons havecollaborated on this document:Jia
2、ng Xin ping IN TAC2Gilles VERLINDE VOMS TAC2Tu Honglei IN TAC2The document comprises 24 pages, all pages have issue no 01.The document is based on template Normal.dot.This issue was last saved on 25.04.2002This document was edited with MS WinWord 2000.Error! No text of specified style in document. 3
3、General InformationIssue ControlThe document comprises 24 pages, all pages have issue no 01.HistoryVersion Release date By comment1.01 2001-06-14 Mr Wang dong xiao First version1.02 2001-10-09 Mr. Jiang xin ping Add the voms Add the check list for voms V6.2.01 2002-04-25 Ms. Tu Honglei Add the check
4、 item for finding the root sessions on SMP and SCP.2.1 2002-05-30 Mr. Wang Dongxiao Add the check items for Database Backup.Add check items for monitor File Exchange manager2.11 2002-06-11 Mr. Wang Dongxiao Add check for the number of login on CC server2.12 2002-07-09 Mr. Wang Dongxiao Add check for
5、 online interface of scp and voms.Add check for confirmation tickets on scp and smpTable 1: HistoryError! No text of specified style in document. 41. Routine Check for SMPAction and Command Remarks Check File System occupancyroot df k Show how many space are available on the system. If you find the
6、capacity of available space close to 0, you can find large file as below: Search for Large filesroot find . size +2000 | xargs ls l Search for new large filesroot find /home* -type f mtime 7 size +2000 Search the core fileroot find /home* -type f name core Check System Performanceroot sar 10 5The re
7、sult like:12:00:55 %usr %sys %wio %idle int/s intdef/s12:01:05 2 4 0 94 6 012:01:15 10 15 2 73 24 012:01:25 4 8 18 69 31 012:01:35 10 15 35 39 67 012:01:45 19 32 43 6 93 0 Note: the %idle should be more than 70% Check all root loginsRoot finger q root Send a broadcast to all users currently logged i
8、nToo many root sessions may lead to the reduction of system performance and security. It is necessary to ask the users who are from unknown position to exit.Write message. e.g. please exit the root loginError! No text of specified style in document. 5Root wall See the number of root loginsRoot finge
9、r |grep root|wc l Root wall Please exit the root login (Ctrl+D to exit) Check Informix log fileInformix log file found under /home/Informix/online.logThis file can be viewed with the commandroot onstat mCheck if the logical log backup successfully. The information should like:Logical Log 2507 Comple
10、teLogical Log 2507 Backup StartedLogical Log 2507 Backup Completed Check Informix logical logsroot onstat lCheck if the logical logs are backup to the tape successfully.Check the status of flags:address number flags uniqid begin size used %used21a25cb8 1 U-B- .21a25cd4 2 U-B- . . .21a25d60 7 U-C-L .
11、If the logical logs are not backup on the tape please check if the tape is mounted on the system. Check Databaseroot su informixinformix onstat Check if the Informix database is online.Error! No text of specified style in document. 6 Check the Processes on the Networkerroot ps ef | grep nsrNormally
12、you should find some processes as below:/opt/nsr/nsrd/opt/nsr/nsrexecd/opt/nsr/nsrmmd n 2/opt/nsr/nsrmmdbd/opt/nsr/nsrindexd/opt/nsr/nsrmmd n 1 Check the tape informationroot nsrmmcheck which tape is mounted Check backup contentmminfo mExample:rootxosmp1:/ # mminfo -mvolume written (%) read expires
13、mounts capacityE SMP_x24smp.001 26 GB 100% 182 MB 03/22/03 21 20 GBE SMP_x24smp.002 25 GB 100% 390 MB 09/24/03 15 20 GBE SMP_x24smp.004 6402 MB 32% 0 KB 10/29/03 24 20 GBSMP_x24smp.013 0 KB 0 KB 11/07/03 0 20 GBE SMP_x24smp.035 5249 MB 26% 0 KB 11/28/03 13 20 GBE SMP_x24smp.036 5282 MB 26% 0 KB 11/2
14、9/03 15 20 GBE SMP_x24smp.037 5316 MB 27% 0 KB 11/30/03 13 20 GBE SMP_x24smp.038 30 MB 0.1% 0 KB 12/01/03 14 20 GBE SMP_x24smp.039 8669 MB 43% 0 KB 12/02/03 14 20 GBE SMP_x24smp.040 7286 MB 36% 0 KB 12/03/03 13 20 GBE SMP_x24smp.041 7412 MB 37% 0 KB 12/05/03 22 20 GBE SMP_x24smp.042 10 MB 0.1% 0 KB
15、12/21/03 16 20 GBSMP_x24smp.125 10 GB 51% 0 KB 03/13/04 9 20 GBSMP_x24smp.126 11 GB 54% 0 KB 03/14/04 9 20 GBSMP_x24smp.127 5952 MB 30% 0 KB 03/15/04 43 20 GBSMP_x24smp.128 10 GB 52% 0 KB 03/16/04 46 20 GBSMP_x24smp.129 11 GB 57% 0 KB 03/17/04 35 20 GBSMP_x24smp.130 10 GB 51% 0 KB 03/18/04 33 20 GBS
16、MP_x24smp.131 9770 MB 49% 0 KB 03/19/04 36 20 GBError! No text of specified style in document. 7 Check Networker backup resultFind file /nsr/logs/daemon.logOpen this log file and check if the defined backup group is backed up successfully.You should find the information like :nsrd: savegroup notice:
17、 SMP_DB_GROUP completed, 1 client(s)(All Succeeded)nsrd: savegroup notice: SMP_SYS_GROUP completed, 1 client(s)(All Succeeded) Check observe SMProot obsinfoCheck the status of observe SMP. The information like:OBSERVE System Information- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - OB
18、SERVE: startedlocal system: x1smp1 status: origremote system: x1smp2 status: backupconnection to remote host: status: yescontrol line 1 operating: status: yescontrol line 2 operating: status: yesstart of observe allowed at reboot: status: yesautorepair: status: noautotake: status: yes Check teleserv
19、ice stateroot telestat 2 Check if the modem is online. Check the HW messageLog in the systemroot cd /usr/bin/larroot ./show_defactsCheck if there is any information about HW_CONFIG defects table.If there is any malfunction of hardware you will get the information about HW_CONFIG defectsError! No tex
20、t of specified style in document. 8 Check if the confirmation tickets jammedroot cd /stat112root ls lroot ls l CCUsually, there is only one or two files under /stat112 and /stat112/CCIf you find there are lots of files under /stat112, but there is no file under /stat112/CC, please check the “move ti
21、cket” crontab.root crontab l smsftac#-# moveticket cronjob for CCserver0,15,30,45 * * * * /var/root/bin/moveticket.sh /stat112/ /stat112/CC/ /dev/nullIf you find there are lots of files under /stat112/CC, please check the LAN/WAN connection between smp to CC server. 2. Routine Check for SCP Check Fi
22、le System occupancyroot df k Show how many space are available on the system. If you find the capacity of available space close to 0, you can find large file as below: Search for Large filesroot find . size +2000 | xargs ls l Search for new large filesroot find /home* -type f mtime 7 size +2000 Sear
23、ch the core fileroot find /home* -type f name core Check System Performanceroot sar 10 5The result like:12:00:55 %usr %sys %wio %idle int/s intdef/s12:01:05 2 4 0 94 6 012:01:15 10 15 2 73 24 012:01:25 4 8 18 69 31 0Error! No text of specified style in document. 912:01:35 10 15 35 39 67 012:01:45 19
24、 32 43 6 93 0 Check all root loginsRoot finger q root Send a broadcast to all users currently logged inRoot wall See the number of root loginsRoot finger |grep root|wc l Too many root sessions may lead to the reduction of system performance and security. It is necessary to ask the users who are from
25、 unknown position to exit.Write message. e.g. please exit the root loginRoot wall Please exit the root login (Ctrl+D to exit) Check Networker backup resultFind file /nsr/logs/daemon.logOpen this log file and check if the defined backup group is backed up successfully.You should find the information
26、like :nsrd: savegroup notice: SCP_DB_GROUP completed, 1 client(s)(All Succeeded)nsrd: savegroup notice: SCP_SYS_GROUP completed, 1 client(s)(All Succeeded) Check the Processes on the Networkerroot ps ef | grep nsrNormally you should find some processes as below:/opt/nsr/nsrd/opt/nsr/nsrexecd/opt/nsr
27、/nsrmmd n 2/opt/nsr/nsrmmdbd/opt/nsr/nsrindexd/opt/nsr/nsrmmd n 1Error! No text of specified style in document. 10 Check the tape informationroot nsrmmExample:rootxosmp1:/ # nsrmm8mm mammoth tape SMP_x24smp.131 mounted on /dev/ios0/rstape003chn, write enabled Check backup contentmminfo mExample:root
28、x24ce01:/#mminfo -mvolume written (%) read expires mounts capacitySCP_x24ce01.001 69 GB full 0 KB 09/18/03 18 20 GBSCP_x24ce01.002 31 GB 100% 17 GB 09/25/03 7 20 GBSCP_x24ce01.003 3496 MB 17% 0 KB 10/29/03 19 20 GBE SCP_x24ce01.004 35 GB full 0 KB 10/08/03 9 20 GBSCP_x24ce01.006 3608 MB 18% 0 KB 10/
29、31/03 1 20 GBSCP_x24ce01.029 25 GB 100% 0 KB 12/02/03 32 20 GBSCP_x24ce01.038 13 GB 65% 0 KB 12/16/03 0 20 GBE SCP_x24ce01.064 13 MB 0.1% 0 KB 01/30/04 0 20 GBSCP_x24ce01.081 11 GB 57% 0 KB 02/18/04 47 20 GBSCP_x24ce01.087 12 GB 58% 0 KB 02/25/04 0 20 GBSCP_x24ce01.102 12 GB 60% 0 KB 03/13/04 58 20
30、GBSCP_x24ce01.103 12 GB 60% 0 KB 03/14/04 67 20 GBE SCP_x24ce01.104 45 MB 0.2% 0 KB 03/15/04 69 20 GBSCP_x24ce01.105 12 GB 60% 0 KB 03/16/04 39 20 GBSCP_x24ce01.106 12 GB 61% 0 KB 03/17/04 8 20 GBSCP_x24ce01.107 12 GB 61% 0 KB 03/18/04 65 20 GBSCP_x24ce01.108 12 GB 61% 0 KB 03/19/04 68 20 GB Check teleservice stateroot telestat 2 Check if the modem is online.