Clustering Peoplesoft - Tuxedo

[skeener]

I have an HA-Oracle environment, and I am adding in HA-Tuxedo to cluster Peoplesoft Enterprise Servers. I've followed the manual and created the appropriate environment files and can bring up the process schedulers successfully outside of VCS, but when I try to online the Tuxedo resources, they become faulted. It appears from the VCS logs that the monitor process does not find the required processes and bails out, faulting the resource. I do see the error messages seen below  in the Tuxedo log (not the VCS tuxedo log).

Thoughts?  Thanks in advance.

090538.mclnsetst02-dev!BBL.9931.1.0: 11-10-2009: Tuxedo Version 8.1, 64-bit, Patch Level 192
090538.mclnsetst02-dev!BBL.9931.1.0: LIBTUX_CAT:262: INFO: Standard main starting
090552.mclnsetst02-dev!PSMSTPRC.9963.1.-2: 11-10-2009: Tuxedo Version 8.1, 64-bit
090552.mclnsetst02-dev!PSMSTPRC.9963.1.-2: LIBTUX_CAT:262: INFO: Standard main starting
090554.mclnsetst02-dev!PSMSTPRC.9963.1.-2: LIBTUX_CAT:250: ERROR: tpsvrinit() failed
090559.mclnsetst02-dev!PSAESRV.10035.1.0: 11-10-2009: Tuxedo Version 8.1, 64-bit
090559.mclnsetst02-dev!PSAESRV.10035.1.0: LIBTUX_CAT:262: INFO: Standard main starting
090600.mclnsetst02-dev!PSAESRV.10035.1.0: LIBTUX_CAT:250: ERROR: tpsvrinit() failed
090603.mclnsetst02-dev!PSAESRV.10055.1.0: 11-10-2009: Tuxedo Version 8.1, 64-bit
090603.mclnsetst02-dev!PSAESRV.10055.1.0: LIBTUX_CAT:262: INFO: Standard main starting
090604.mclnsetst02-dev!PSAESRV.10055.1.0: LIBTUX_CAT:250: ERROR: tpsvrinit() failed
090607.mclnsetst02-dev!PSDSTSRV.10430.1.0: 11-10-2009: Tuxedo Version 8.1, 64-bit
090607.mclnsetst02-dev!PSDSTSRV.10430.1.0: LIBTUX_CAT:262: INFO: Standard main starting
090608.mclnsetst02-dev!PSDSTSRV.10430.1.0: LIBTUX_CAT:250: ERROR: tpsvrinit() failed
090610.mclnsetst02-dev!PSDSTSRV.10766.1.0: 11-10-2009: Tuxedo Version 8.1, 64-bit
090610.mclnsetst02-dev!PSDSTSRV.10766.1.0: LIBTUX_CAT:262: INFO: Standard main starting
090622.mclnsetst02-dev!PSPRCSRV.11322.1.-2: 11-10-2009: Tuxedo Version 8.1, 64-bit
090622.mclnsetst02-dev!PSPRCSRV.11322.1.-2: LIBTUX_CAT:262: INFO: Standard main starting
090629.mclnsetst02-dev!PSMONITORSRV.11472.1.-2: 11-10-2009: Tuxedo Version 8.1, 64-bit
090629.mclnsetst02-dev!PSMONITORSRV.11472.1.-2: LIBTUX_CAT:262: INFO: Standard main starting
090842.mclnsetst02-dev!BBL.9931.1.0: ERROR: msgrcv err(LIBTUX_CAT:666: ERROR: Message operation failed because the queue was removed): errno=36,qid=4,buf=4297083432,bytes=4568,type=-1073741824,flag=0
090842.mclnsetst02-dev!BBL.9931.1.0: ERROR: msgrcv err(LIBTUX_CAT:669: ERROR: Message operation failed because of the invalid message queue identifier): errno=22,qid=4,buf=4297083432,bytes=4568,type=0,flag=0
090842.mclnsetst02-dev!BBL.9931.1.0: LIBTUX_CAT:271: ERROR: System lock semop failure, key = 58225 (errno = 22)
090842.mclnsetst02-dev!BBL.9931.1.0: LIBTUX_CAT:268: ERROR: Failed to stop serving
090842.mclnsetst02-dev!BBL.9931.1.0: CMDTUX_CAT:26: INFO: The BBL is exiting system
090842.mclnsetst02-dev!PSPRCSRV.11322.1.-2: ERROR: msgrcv err(LIBTUX_CAT:669: ERROR: Message operation failed because of the invalid message queue identifier): errno=22,qid=40,buf=4303485208,bytes=4568,type=-1073741824,flag=2048
090842.mclnsetst02-dev!PSPRCSRV.11322.1.-2: LIBTUX_CAT:271: ERROR: System lock semop failure, key = 58225 (errno = 22)
090842.mclnsetst02-dev!PSPRCSRV.11322.1.-2: LIBTUX_CAT:268: ERROR: Failed to stop serving
090843.mclnsetst02-dev!PSMONITORSRV.11472.1.-2: ERROR: msgrcv err(LIBTUX_CAT:669: ERROR: Message operation failed because of the invalid message queue identifier): errno=22,qid=48,buf=4308578152,bytes=4568,type=-1073741824,flag=2048
090843.mclnsetst02-dev!PSMONITORSRV.11472.1.-2: LIBTUX_CAT:268: ERROR: Failed to stop serving
091038.mclnsetst02-dev!PSDSTSRV.10766.1.0: LIBTUX_CAT:271: ERROR: System lock semop failure, key = 58225 (errno = 2)
091038.mclnsetst02-dev!PSDSTSRV.10766.1.0: ERROR: msgrcv err(LIBTUX_CAT:669: ERROR: Message operation failed because of the invalid message queue identifier): errno=22,qid=30,buf=4304221560,bytes=4568,type=-1073741824,flag=0
091038.mclnsetst02-dev!PSDSTSRV.10766.1.0: LIBTUX_CAT:271: ERROR: System lock semop failure, key = 58225 (errno = 22)
091038.mclnsetst02-dev!PSDSTSRV.10766.1.0: LIBTUX_CAT:268: ERROR: Failed to stop serving

[Satish_K__Pagar]

Hi Skeener,

I am assuming that you are using the "Tuxedo" agent in your setup. You may want to set the ResLogLevel of this Tuxedo resource
to "TRACE" and then bring it online through VCS. The agent would generate helpful debug log messages in the file /var/VRTSvcs/log/Tuxedo_A.log
and /var/VRTSvcs/log/engine_A.log. You can use these files to debug the problem. There is a section in the install config guide of the Tuxedo agent on how to test the Tuxedo environment file. Please go through the section and check if the environment is setup correctly.

Hope that helps,
Satish/

[skeener]

Thank you for your response, Satish. I have already referenced the install config guide for Tuxedo and setup the Tuxedo environment and confirmed that I can bring up each process scheduler successfully outside of VCS. After setting the log level to TRACE at your recommendation, I do see that the Tuxedo process scheduler successfully starts, but then it faults...complaining that not all required processes are running. I have read the document that describes how to troubleshoot Tuxedo in VCS, and see that the monitor for the Tuxedo agent will first check for pidfile.BBL in /tmp/.VRTSTuxedo/<tuxresourcename>/PID. If it does not find the pidfile.BBL file, it will start looking for the required processes associated with the environment (BBL, PSAESRV, PSDSTSRV etc.). The /tmp/.VRTSTuxedo/<tuxresourcename>/PID directory exists, but there is no pidfile.BBL file, so it is proceeding to check for the required processes, whereby it does not find them and eventually faults:

ffdc:20103:<Tuxedo::GetProcState> Tuxedo process details ---

Process      [BBL]
Srch Process [(?-xism:^BBL\b\s.*\bmclnsetst01-dev\b.*/opt/psoft/el848prd/appserv/prcs/PSELPRD\b)]
FLM Status   [100]

--------------------
Return code is [100]
ffdc:20084:<Tuxedo::GetResourceState> Did not find all required processes. Returning [100]

What exact processes is it searching for and why is it faulting when the Tuxedo processes are indeed running?

2009/11/16 10:01:15 VCS INFO V-16-55018-10188 Resource(tuxelprd) - (mclnsetst01-dev:monitor) Sys:RunWithEnvCmdWithOutputW
ithTimeOut:Subroutine <Sys::RunWithEnvCmdWithOutputWithTimeOut> called with:
ffdc:20095:<Tuxedo::GetProcState> Searching PID [13916] UID [0] CMD [sendmail: ./nAGErhKn013914 mclniron02-ext.bah.com.:
user open]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [14312] UID [131] CMD [BBL -C dom=PSUNX_58225 -g 30002 -i 0 -u mclnsetst0
2-dev -U /opt/psoft/el848prd/appserv/prcs/PSELPRD/LOGS/TUXLOG -m 0 -A]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [14314] UID [131] CMD [PSMSTPRC -C dom=PSUNX_58225 -g 1 -i 102 -u mclnset
st02-dev -U /opt/psoft/el848prd/appserv/prcs/PSELPRD/LOGS/TUXLOG -m 0 -A -- -C psprcs.cfg -CD ELPRD -PS PSUNX -A start -S
 PSMSTPRC]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [14318] UID [105] CMD [oracleELPRD (LOCAL=NO)]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [14326] UID [131] CMD [PSAESRV -C dom=PSUNX_58225 -g 101 -i 1 -u mclnsets
t02-dev -U /opt/psoft/el848prd/appserv/prcs/PSELPRD/LOGS/TUXLOG -m 0 -- -C psprcs.cfg -CD ELPRD -S PSAESRV]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [14378] UID [105] CMD [oracleELPRD (LOCAL=NO)]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [14424] UID [131] CMD [PSAESRV -C dom=PSUNX_58225 -g 101 -i 2 -u mclnsets
t02-dev -U /opt/psoft/el848prd/appserv/prcs/PSELPRD/LOGS/TUXLOG -m 0 -- -C psprcs.cfg -CD ELPRD -S PSAESRV]]
2009/11/16 10:01:15 VCS NOTICE V-16-55018-10286 Resource(tuxelprd) - (mclnsetst01-dev:monitor) VCSagentFW:messageEngineLo
g:[ffdc:20095:<Tuxedo::GetProcState> Searching PID [14503] UID [105] CMD [oracleELPRD (LOCAL=NO)]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [14516] UID [131] CMD [PSDSTSRV -C dom=PSUNX_58225 -g 1 -i 104 -u mclnset
st02-dev -U /opt/psoft/el848prd/appserv/prcs/PSELPRD/LOGS/TUXLOG -m 0 -sPostReport -- -C psprcs.cfg -CD ELPRD -PS PSUNX -
A start -S PSDSTSRV]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [14520] UID [105] CMD [oracleELPRD (LOCAL=NO)]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [14537] UID [131] CMD [PSDSTSRV -C dom=PSUNX_58225 -g 1 -i 103 -u mclnset
st02-dev -U /opt/psoft/el848prd/appserv/prcs/PSELPRD/LOGS/TUXLOG -m 0 -sPostReport -- -C psprcs.cfg -CD ELPRD -PS PSUNX -
A start -S PSDSTSRV]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [14542] UID [105] CMD [oracleELPRD (LOCAL=NO)]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [14547] UID [131] CMD [PSPRCSRV -C dom=PSUNX_58225 -g 1 -i 101 -u mclnset
st02-dev -U /opt/psoft/el848prd/appserv/prcs/PSELPRD/LOGS/TUXLOG -m 0 -sInitiateRequest -- -C psprcs.cfg -CD ELPRD -PS PS
UNX -A start -S PSPRCSRV]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [14558] UID [105] CMD [oracleELPRD (LOCAL=NO)]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [14566] UID [131] CMD [PSMONITORSRV -C dom=PSUNX_58225 -g 50 -i 1 -u mcln
setst02-dev -U /opt/psoft/el848prd/appserv/prcs/PSELPRD/LOGS/TUXLOG -m 0 -A -- -ID 58225 -C psprcs.cfg -PS PSUNX -S PSMON
ITORSRV]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [14571] UID [105] CMD [oracleELPRD (LOCAL=NO)]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [14585] UID [0] CMD [sendmail: ./nAGEteEc014583 mclniron02-ext.bah.com.:
user open]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [15000] UID [0] CMD [sendmail: ./nAGEvXun014998 mclniron01-ext.bah.com.:
user open]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [15179] UID [162] CMD [psae -CT ORACLE -CD PAEXTPRD -GUID 6d5de50e-d2c0-1
1de-925a-d60d25261252 -SS NO -SN NO]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [15189] UID [105] CMD [oraclePAEXTPRD (LOCAL=NO)]
@

ffdc:20095:<Tuxedo::GetProcState> Searching PID [11875] UID [105] CMD [ora_p035_PSHRPRD]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [11877] UID [105] CMD [ora_p036_PSHRPRD]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [11879] UID [105] CMD [ora_p037_PSHRPRD]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [11881] UID [105] CMD [ora_p038_PSHRPRD]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [11883] UID [105] CMD [ora_p039_PSHRPRD]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [11885] UID [105] CMD [ora_p040_PSHRPRD]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [11887] UID [105] CMD [ora_p041_PSHRPRD]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [11889] UID [105] CMD [ora_p042_PSHRPRD]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [11891] UID [105] CMD [ora_p043_PSHRPRD]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [11893] UID [105] CMD [ora_p044_PSHRPRD]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [11895] UID [105] CMD [ora_p045_PSHRPRD]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [11897] UID [105] CMD [ora_p046_PSHRPRD]]
2009/11/16 10:01:14 VCS NOTICE V-16-55018-10286 Resource(tuxelprd) - (mclnsetst01-dev:monitor) VCSagentFW:messageEngineLo
g:[ffdc:20095:<Tuxedo::GetProcState> Searching PID [11899] UID [105] CMD [ora_p047_PSHRPRD]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [11901] UID [105] CMD [ora_p048_PSHRPRD]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [11903] UID [105] CMD [ora_p049_PSHRPRD]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [11905] UID [105] CMD [ora_p050_PSHRPRD]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [11907] UID [105] CMD [ora_p051_PSHRPRD]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [11909] UID [105] CMD [ora_p052_PSHRPRD]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [11912] UID [105] CMD [ora_p053_PSHRPRD]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [11914] UID [105] CMD [ora_p054_PSHRPRD]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [11916] UID [105] CMD [ora_p055_PSHRPRD]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [11918] UID [105] CMD [ora_p056_PSHRPRD]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [11921] UID [105] CMD [ora_p057_PSHRPRD]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [11923] UID [105] CMD [ora_p058_PSHRPRD]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [11925] UID [105] CMD [ora_p059_PSHRPRD]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [11927] UID [105] CMD [ora_p060_PSHRPRD]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [11929] UID [105] CMD [ora_p061_PSHRPRD]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [11933] UID [105] CMD [ora_p062_PSHRPRD]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [11935] UID [105] CMD [ora_p063_PSHRPRD]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [13120] UID [117] CMD [pssqr /var/tmp/CBAjiaqar]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [13122] UID [117] CMD [/opt/psoft/hr848prd/bin/sqr/ORA/bin/sqr -ZCF/opt/p
soft/hr848prd/appserv/prcs/PSHRPRD/log_output/SQR_BAHI403_1538271/AAA2faaOz]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [13125] UID [105] CMD [oraclePSHRPRD (LOCAL=NO)]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [13683] UID [105] CMD [oraclePAPRD (LOCAL=NO)]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [13916] UID [0] CMD [sendmail: ./nAGErhKn013914 mclniron02-ext.bah.com.:
user open]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [14312] UID [131] CMD [BBL -C dom=PSUNX_58225 -g 30002 -i 0 -u mclnsetst0
2-dev -U /opt/psoft/el848prd/appserv/prcs/PSELPRD/LOGS/TUXLOG -m 0 -A]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [14314] UID [131] CMD [PSMSTPRC -C dom=PSUNX_58225 -g 1 -i 102 -u mclnset
st02-dev -U /opt/psoft/el848prd/appserv/prcs/PSELPRD/LOGS/TUXLOG -m 0 -A -- -C psprcs.cfg -CD ELPRD -PS PSUNX -A start -S
 PSMSTPRC]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [14318] UID [105] CMD [oracleELPRD (LOCAL=NO)]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [14326] UID [131] CMD [PSAESRV -C dom=PSUNX_58225 -g 101 -i 1 -u mclnsets
t02-dev -U /opt/psoft/el848prd/appserv/prcs/PSELPRD/LOGS/TUXLOG -m 0 -- -C psprcs.cfg -CD ELPRD -S PSAESRV]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [14378] UID [105] CMD [oracleELPRD (LOCAL=NO)]

ffdc:20095:<Tuxedo::GetProcState> Searching PID [14326] UID [131] CMD [PSAESRV -C dom=PSUNX_58225 -g 101 -i 1 -u mclnsets
t02-dev -U /opt/psoft/el848prd/appserv/prcs/PSELPRD/LOGS/TUXLOG -m 0 -- -C psprcs.cfg -CD ELPRD -S PSAESRV]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [14378] UID [105] CMD [oracleELPRD (LOCAL=NO)]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [14424] UID [131] CMD [PSAESRV -C dom=PSUNX_58225 -g 101 -i 2 -u mclnsets
t02-dev -U /opt/psoft/el848prd/appserv/prcs/PSELPRD/LOGS/TUXLOG -m 0 -- -C psprcs.cfg -CD ELPRD -S PSAESRV]]
2009/11/16 10:01:15 VCS NOTICE V-16-55018-10286 Resource(tuxelprd) - (mclnsetst01-dev:monitor) VCSagentFW:messageEngineLo
g:[ffdc:20095:<Tuxedo::GetProcState> Searching PID [14503] UID [105] CMD [oracleELPRD (LOCAL=NO)]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [14516] UID [131] CMD [PSDSTSRV -C dom=PSUNX_58225 -g 1 -i 104 -u mclnset
st02-dev -U /opt/psoft/el848prd/appserv/prcs/PSELPRD/LOGS/TUXLOG -m 0 -sPostReport -- -C psprcs.cfg -CD ELPRD -PS PSUNX -
A start -S PSDSTSRV]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [14520] UID [105] CMD [oracleELPRD (LOCAL=NO)]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [14537] UID [131] CMD [PSDSTSRV -C dom=PSUNX_58225 -g 1 -i 103 -u mclnset
st02-dev -U /opt/psoft/el848prd/appserv/prcs/PSELPRD/LOGS/TUXLOG -m 0 -sPostReport -- -C psprcs.cfg -CD ELPRD -PS PSUNX -
A start -S PSDSTSRV]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [14542] UID [105] CMD [oracleELPRD (LOCAL=NO)]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [14547] UID [131] CMD [PSPRCSRV -C dom=PSUNX_58225 -g 1 -i 101 -u mclnset
st02-dev -U /opt/psoft/el848prd/appserv/prcs/PSELPRD/LOGS/TUXLOG -m 0 -sInitiateRequest -- -C psprcs.cfg -CD ELPRD -PS PS
UNX -A start -S PSPRCSRV]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [14558] UID [105] CMD [oracleELPRD (LOCAL=NO)]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [14566] UID [131] CMD [PSMONITORSRV -C dom=PSUNX_58225 -g 50 -i 1 -u mcln
setst02-dev -U /opt/psoft/el848prd/appserv/prcs/PSELPRD/LOGS/TUXLOG -m 0 -A -- -ID 58225 -C psprcs.cfg -PS PSUNX -S PSMON
ITORSRV]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [14571] UID [105] CMD [oracleELPRD (LOCAL=NO)]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [14585] UID [0] CMD [sendmail: ./nAGEteEc014583 mclniron02-ext.bah.com.:
user open]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [15000] UID [0] CMD [sendmail: ./nAGEvXun014998 mclniron01-ext.bah.com.:
user open]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [15179] UID [162] CMD [psae -CT ORACLE -CD PAEXTPRD -GUID 6d5de50e-d2c0-1
1de-925a-d60d25261252 -SS NO -SN NO]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [15189] UID [105] CMD [oraclePAEXTPRD (LOCAL=NO)]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [15487] UID [0] CMD [sendmail: ./nAGExRYc015485 mclniron02-ext.bah.com.:
user open]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [15664] UID [105] CMD [ora_j000_PAPRD]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [15668] UID [105] CMD [ora_j000_PSHRPRD]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [15675] UID [105] CMD [ora_j000_ELPRD]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [15952] UID [105] CMD [ora_j001_PSHRPRD]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [15954] UID [105] CMD [ora_j002_PSHRPRD]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [15956] UID [105] CMD [ora_j003_PSHRPRD]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [15958] UID [0] CMD [/usr/ucb/ps -axwwl]

ffdc:20095:<Tuxedo::GetProcState> Searching PID [15956] UID [105] CMD [ora_j003_PSHRPRD]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [15958] UID [0] CMD [/usr/ucb/ps -axwwl]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [25517] UID [1012] CMD [/opt/quest/qmxcm/libexec/qmxsmsoopcpp1pr --provid
er=/opt/quest/qmxcm/lib/providers/libqmxsms_sms_policy_monitor.so]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [1971] UID [0] CMD [/usr/lib/saf/ttymon -g -d /dev/console -l console -T
vt100 -m ldterm,ttcompat -h -p mclnsetst01-dev console login:]]
2009/11/16 10:01:15 VCS NOTICE V-16-55018-10287 Resource(tuxelprd) - (mclnsetst01-dev:monitor) VCSagentFW:messageEngineLo
g:[
ffdc:20095:<Tuxedo::GetProcState> Searching PID [330] UID [1001] CMD [-ksh]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [346] UID [0] CMD [/bin/ksh]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [15395] UID [0] CMD [vi Tuxedo_A.log]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [356] UID [1001] CMD [-ksh]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [377] UID [0] CMD [/bin/ksh]
ffdc:20095:<Tuxedo::GetProcState> Searching PID [379] UID [0] CMD [/opt/VRTSjre/jre1.5/bin/java -Dbase.dir=/opt/VRTSvcs/g
ui -Dattrpool.dir=/var/VRTSvcs/gui -Dswing.metalTheme=steel -classpath /opt/VRTSvcs/gui/:/opt/VRTSvcs/gui/lang:/opt/VRTSv
cs/gui/lib/VCSGui.jar:/opt/VRTSvcs/gui/lib/gui_images.jar:/opt/VRTSvcs/gui/lib/sounds.jar:/opt/VRTSvcs/gui/lib/VxHelpView
er.jar:/opt/VRTSvcs/gui/lib/VxHelpViewerl10n.jar:/opt/VRTSjre/jre1.5/lib/rt.jar:/opt/VRTSjre/jre1.5/lib/i18n.jar:/opt/VRT
Sat/lib/AtWrapper.jar -mx128m VCSGui]

Thanks.

[Satish_K__Pagar]

Can you please verify the value of the attribute MachineName in your configuration. Looks like you have specified the value as
mclnsetst01-dev, but in the process listing the Tuxedo server are coming up with a value of mclnsetst02-dev. It would also help
if you could paste tuxedo instance related section from your main.cf

[skeener]

Thank you, Satish! Changing the MachineName to mclnsetst02-dev fixed the problem with the Tuxedo instances not staying up! My reading about this MachineName attribute caused me to come to the conclusion that the value wasn't important....since the description of the attribute says "Although not required for clustering"....then further in the description it says "Specifying this attribute is required".

Can you explain this to me?

Thank you again, Satish.

[Satish_K__Pagar · Accepted solution]

Hi Skeener , the context of "although not required for clustering" is important here :)
<snip>
Logical machine name (LMID) assigned to this BEA Tuxedo machine as specified in the BEA Tuxedo configuration file. Although not required for clustering, to avoid confusion in the BEA Tuxedo configuration file, consider setting the machine's physical machine name (PMID) and the LMID to the same value.
</snip>

The attribute is required and the description says "consider setting the machine's physical machine name and the LMID to the same value to avoid confusion." and setting it to the same value is not required for clustering but its just to avoid confusion. Hope that helps.

[skeener]

Thank you for your explanation, Satish. One more question...how can the PMID and the LMID be the same at all times? There will be cases where the failover node (mclnsetst02-dev) will take control of the service group that the Tuxedo resources reside in.

Thanks again!

skeener

[Satish_K__Pagar]

Those are logical entities that Tuxedo uses. PMID is the Tuxedo Machine and it need not be the same as the physical machine. So in case of VCS , you can use the virtual hostname (failover-able) as the PMID.

[skeener]

Thank you again, Satish!

I don't see PMID as a VCS attribute for the Tuxedo resource...the PMID is defined in the psprcsrv.ubb file for the process scheduler?

Thank you.

[Satish_K__Pagar]

Yes, I think that is the place. Here's a snippet of the description of "EnvFile" attribute
"Also consider setting the PMID enviroment variable to the MachineName attribute value in this file, which is the same as defined in the MACHINES section of the UBBCONFIG file."