NBU running process is not showing correctly

[gaurav_372]

Hi,

We are running NBU 7.5.0.7 on solaris 5.10,We noticed abnormal behaving for some NBU processes on master server  and running time is changing very quickly. We killed all NBU processes/ restated NBU servies/Rebooted the master server but its not helping 

Below is the output for few processes. 

===============

root@ # bpps | egrep -i 'nbpem|bpjobd|nbsl|nbjm|nbrb|nbemm|dbsrv';date
    root 26458     1   2 05:13:33 ?         602:58 /usr/openv/db//bin/NB_dbsrv @/usr/openv/var/global/server.conf @/usr/openv/var/
    root 27832     1   0 05:13:49 ?          13:14 /usr/openv/netbackup/bin/nbrb
    root 28308     1   0 05:13:56 ?          23:27 /usr/openv/netbackup/bin/nbjm
    root 28820 28503   0 05:14:03 ?           1:04 /usr/openv/netbackup/bin/nbproxy dblib nbpem
    root 22612 28503   0 05:35:21 ?           0:04 /usr/openv/netbackup/bin/nbproxy dblib nbpem_cleanup
    root 28817 28308   0 05:14:03 ?           0:12 /usr/openv/netbackup/bin/nbproxy dblib nbjm
    root 27683     1   0 05:13:48 ?          43:19 /usr/openv/netbackup/bin/nbemm
    root 29534     1   0 05:14:15 ?          37:02 /usr/openv/netbackup/bin/nbsl
    root 28312 28260   0 05:13:56 ?          16:34 /usr/openv/netbackup/bin/bpjobd
    root 28503     1   0 05:13:58 ?          15:45 /usr/openv/netbackup/bin/nbpem
    root 22834 28503   0 06:33:32 ?           0:19 /usr/openv/netbackup/bin/nbproxy dblib nbpem_email
Sat Aug 23 07:09:31 EDT 2014

/root
root@ # bpps | egrep -i 'nbpem|bpjobd|nbsl|nbjm|nbrb|nbemm|dbsrv';date
    root 26458     1   2 05:13:33 ?         611:04 /usr/openv/db//bin/NB_dbsrv @/usr/openv/var/global/server.conf @/usr/openv/var/
    root 27832     1   0 05:13:49 ?          13:17 /usr/openv/netbackup/bin/nbrb
    root 28308     1   0 05:13:56 ?          23:42 /usr/openv/netbackup/bin/nbjm
    root 28820 28503   0 05:14:03 ?           1:04 /usr/openv/netbackup/bin/nbproxy dblib nbpem
    root 22612 28503   0 05:35:21 ?           0:04 /usr/openv/netbackup/bin/nbproxy dblib nbpem_cleanup
    root 28817 28308   0 05:14:03 ?           0:13 /usr/openv/netbackup/bin/nbproxy dblib nbjm
    root 27683     1   0 05:13:48 ?          43:44 /usr/openv/netbackup/bin/nbemm
    root 29534     1   0 05:14:15 ?          37:10 /usr/openv/netbackup/bin/nbsl
    root 28312 28260   0 05:13:56 ?          16:41 /usr/openv/netbackup/bin/bpjobd
    root 28503     1   0 05:13:58 ?          15:48 /usr/openv/netbackup/bin/nbpem
    root 22834 28503   0 06:33:32 ?           0:19 /usr/openv/netbackup/bin/nbproxy dblib nbpem_email
Sat Aug 23 07:10:54 EDT 2014

/root
root@ # bpps | egrep -i 'nbpem|bpjobd|nbsl|nbjm|nbrb|nbemm|dbsrv';date
    root 26458     1   2 05:13:33 ?         618:50 /usr/openv/db//bin/NB_dbsrv @/usr/openv/var/global/server.conf @/usr/openv/var/
    root 27832     1   0 05:13:49 ?          13:19 /usr/openv/netbackup/bin/nbrb
    root 28308     1   0 05:13:56 ?          23:53 /usr/openv/netbackup/bin/nbjm
    root 28820 28503   0 05:14:03 ?           1:04 /usr/openv/netbackup/bin/nbproxy dblib nbpem
    root 22612 28503   0 05:35:21 ?           0:04 /usr/openv/netbackup/bin/nbproxy dblib nbpem_cleanup
    root 28817 28308   0 05:14:03 ?           0:13 /usr/openv/netbackup/bin/nbproxy dblib nbjm
    root 27683     1   0 05:13:48 ?          44:02 /usr/openv/netbackup/bin/nbemm
    root 29534     1   0 05:14:15 ?          37:18 /usr/openv/netbackup/bin/nbsl
    root 28312 28260   0 05:13:56 ?          16:45 /usr/openv/netbackup/bin/bpjobd
    root 28503     1   0 05:13:58 ?          15:49 /usr/openv/netbackup/bin/nbpem
    root 22834 28503   0 06:33:32 ?           0:19 /usr/openv/netbackup/bin/nbproxy dblib nbpem_email
Sat Aug 23 07:12:07 EDT 2014

/root
root@ #

=============

Could some one please assist on this. Attaching bpps -x output as well.

Regards,

Gaurav

[Marianne]

We noticed abnormal behaving for some NBU processes ....

So, what exactly is 'abnormal' in your view?

From what I see - especially the attachment with bpps -x output - this is pretty normal for a busy master/media server.

[gaurav_372]

HI Mariaanne,

if you notice process running time,then its telling us a different story.

Below is a sample:

uptime

  6:16am  up 1 day(s), 23:09,  8 users,  load average: 35.47, 33.92, 31.95

Snipted from "bpps -x"

root  6186     1   0   Aug 24 ?         117:17 /usr/openv/netbackup/bin/nbrb
    root  7974     1   1   Aug 24 ?         494:25 /usr/openv/netbackup/bin/nbjm
    root  5701     1   0   Aug 24 ?         734:50 /usr/openv/netbackup/bin/nbemm
    root  1875     1   1   Aug 24 ?        14030:29 /usr/openv/db//bin/NB_dbsrv @/usr/openv/var/global/server.conf @/usr/openv/var/

root  8217  8077   0   Aug 24 ?         323:19 /usr/openv/netbackup/bin/bpjobd

We are having other issues on master server, We are following in other thread.

"https://www-secure.symantec.com/connect/forums/jobs-queued-state-waiting-netbackup-scheduler-work-queue-server"

Regards,

Gaurav

[Marianne]

Uptime shows that the server was rebooted about 2 days ago.

bpps shows processes running since 24 Aug. 2 days ago.

Yes I can see that the timestamp looks weird. 
Seems to be more of an issue on the OS side, rather than NBU.

What does 'ps -ef ' show for these processes?

Any chance that the system date/time was changed recently?