media server drives failing on boot - reinstall questions

[lovethatcheese]

Hello. Have a media server on Windows 2008 server r2 enterprise with attached tape drive / equali logic san..this media server is giving me errors on boot, and new drives have been ordered. Still looking into why my RAID mirroring failed, but that's another story.

My question- all backups are either on tape or the attached (external) SAN. If I need to reinstall the OS on this, am I going to be able to:

(as an aside - my catalog backup file is going to a different media server)

a) quickly reimport my existing images?

b) is this going to be an easy fix (i.e. as simple as reinstalling Windows server)?

c) having backups going over wan is not an option, so I will be without backups until we get new drives in. Not the end of the world. Just wanted to avoid having to re-import these existing images manually.

My master is on the same OS.

Any help is greatly appreciated.

-Scott

[Marianne]

a) No catalogs/images reside on the media server - everything is kept on the master. So, no need to import anything.

b) Yes. For now, deactivate the media server. After reinstallation, verify that the OS can see devices, then activate the media server and run Device Config Wizard for this media server.

[mph999]

Just to add to Mariannes excellent post

The customised parts of a media server are really only bp.conf / registrey which should be recretated on install and 'tuning' files in /usr/open/netbackup/db/config, for example SIZE_DATA_BUFFERS / NUMBER_DATA_BUFFERS.  

Reinstall will recreate bp.conf / registry to a working level.  Can't really comment on anything additional that 'might' have been in there as I don't know the system.

As I always say, it is a really really good idea to run nbsu -c -t regularly on the master and medias as this will capture various things that could have been changed from default.

I don;t think it gets the registry details though, so you could export the registry now and again to record the settings.

Martin

[lovethatcheese]

Marianne,

Thanks for the very prompt reply! I just deactivated the media server in question and will install the OS tomorrow. I will leave this forum open until then - I'm already anticipating issues with being able to re-import the existing tapes into the environment... should I delete them first? I imagine I'll get an error about duplicate barcodes now? 

[lovethatcheese]

Update -  I deactivated the media server and policy, and the OS was reinstalled today. I got NB 7.5.0.6 installed and am ready to get back up and running.

Prob a stupid question - I don't get the option to 'activate' this media server now, it's greyed out. It is reporting as 'Offline'. I can deactivate it (or at least its not greyed out) but that didn't do anything.

I have active jobs on my master and have not restarted services on master after reinstalled this media server - is that my problem or am I overlooking something? The machine name / IP are all the same, edited the hosts file as I always do....firewall off.

as the network info is the same, the firewall on my master shouldn't be an issue - It's open to the required ports on that IP.

-Scott

[Marianne]

Same licenses added on media server as before?

Please post output of these commands on the master server:

nbemmcmd -listhosts -verbose
nbemmcmd -getemmserver

These commands will confirm comms with the media server.

[lovethatcheese]

Here's listhosts -verbose -

C:\PROGRA~1\Veritas\NetBackup\bin\admincmd>nbemmcmd -listhosts -verbose
NBEMMCMD, Version: 7.5.0.4
The following hosts were found:
mumedia
        ClusterName = ""
        MachineName = "mumedia"
        FQName = "mumedia"
        LocalDriveSeed = ""
        MachineDescription = ""
        MachineFlags = 0x17
        MachineNbuType = media (1)
        MachineState = active for disk jobs (12)
        MasterServerName = "nbflmaster"
        NetBackupVersion = 7.5.0.4 (750400)
        OperatingSystem = windows (11)
        ScanAbility = 5
cymedia
        ClusterName = ""
        MachineName = "cymedia"
        FQName = "cymedia"
        LocalDriveSeed = ""
        MachineDescription = ""
        MachineFlags = 0x17
        MachineNbuType = media (1)
        MachineState = active for disk jobs (12)
        MasterServerName = "nbflmaster"
        NetBackupVersion = 7.5.0.4 (750400)
        OperatingSystem = windows (11)
        ScanAbility = 5
phmedia
        ClusterName = ""
        MachineName = "phmedia"
        FQName = "phmedia"
        LocalDriveSeed = ""
        MachineDescription = ""
        MachineFlags = 0x17
        MachineNbuType = media (1)
        MachineState = active for disk jobs (12)
        MasterServerName = "nbflmaster"
        NetBackupVersion = 7.5.0.4 (750400)
        OperatingSystem = windows (11)
        ScanAbility = 5
jkmedia
        ClusterName = ""
        MachineName = "jkmedia"
        FQName = "jkmedia"
        LocalDriveSeed = ""
        MachineDescription = ""
        MachineFlags = 0x17
        MachineNbuType = media (1)
        MachineState = active for disk jobs (12)
        MasterServerName = "nbflmaster"
        NetBackupVersion = 7.5.0.4 (750400)
        OperatingSystem = windows (11)
        ScanAbility = 5
cwmedia
        ClusterName = ""
        MachineName = "cwmedia"
        FQName = "cwmedia"
        LocalDriveSeed = ""
        MachineDescription = ""
        MachineFlags = 0x17
        MachineNbuType = media (1)
        MachineState = active for disk jobs (12)
        MasterServerName = "nbflmaster"
        NetBackupVersion = 7.5.0.4 (750400)
        OperatingSystem = windows (11)
        ScanAbility = 5
apnetbackup
        ClusterName = ""
        MachineName = "apnetbackup"
        FQName = "apnetbackup"
        LocalDriveSeed = ""
        MachineDescription = ""
        MachineFlags = 0x17
        MachineNbuType = media (1)
        MachineState = active for disk jobs (12)
        MasterServerName = "nbflmaster"
        NetBackupVersion = 7.5.0.4 (750400)
        OperatingSystem = windows (11)
        ScanAbility = 5
ctmedia
        ClusterName = ""
        MachineName = "ctmedia"
        FQName = "ctmedia"
        LocalDriveSeed = ""
        MachineDescription = ""
        MachineFlags = 0x17
        MachineNbuType = media (1)
        MachineState = active for disk jobs (12)
        MasterServerName = "nbflmaster"
        NetBackupVersion = 7.5.0.4 (750400)
        OperatingSystem = windows (11)
        ScanAbility = 5
camedia
        ClusterName = ""
        MachineName = "camedia"
        FQName = "camedia"
        LocalDriveSeed = ""
        MachineDescription = ""
        MachineFlags = 0x17
        MachineNbuType = media (1)
        MachineState = active for disk jobs (12)
        MasterServerName = "nbflmaster"
        NetBackupVersion = 7.5.0.4 (750400)
        OperatingSystem = windows (11)
        ScanAbility = 5
ownetbackup
        ClusterName = ""
        MachineName = "ownetbackup"
        FQName = "ownetbackup"
        LocalDriveSeed = ""
        MachineDescription = ""
        MachineFlags = 0x17
        MachineNbuType = media (1)
        MachineState = active for disk jobs (12)
        MasterServerName = "nbflmaster"
        NetBackupVersion = 7.5.0.4 (750400)
        OperatingSystem = windows (11)
        ScanAbility = 5
ahmedia
        ClusterName = ""
        MachineName = "ahmedia"
        FQName = "ahmedia"
        LocalDriveSeed = ""
        MachineDescription = ""
        MachineFlags = 0x17
        MachineNbuType = media (1)
        MachineState = not active for tape or disk jobs (8)
        MasterServerName = "nbflmaster"
        NetBackupVersion = 7.5.0.0 (750000)
        OperatingSystem = windows (11)
        ScanAbility = 5
flintmedia
        ClusterName = ""
        MachineName = "flintmedia"
        FQName = "flintmedia"
        LocalDriveSeed = ""
        MachineDescription = ""
        MachineFlags = 0x17
        MachineNbuType = media (1)
        MachineState = active for disk jobs (12)
        MasterServerName = "nbflmaster"
        NetBackupVersion = 7.5.0.4 (750400)
        OperatingSystem = windows (11)
        ScanAbility = 5
nbflmaster
        ClusterName = ""
        MachineName = "nbflmaster"
        FQName = "nbflmaster"
        GlobalDriveSeed = "VEND:#.:PROD:#.:IDX"
        LocalDriveSeed = ""
        MachineDescription = ""
        MachineFlags = 0x17
        MachineNbuType = master (3)
        MachineState = active for disk jobs (12)
        NetBackupVersion = 7.5.0.4 (750400)
        OperatingSystem = windows (11)
        ScanAbility = 5
mumedia
        MachineName = "mumedia"
        FQName = "mumedia"
        MachineDescription = "PureDisk"
        MachineFlags = 0x2
        MachineNbuType = ndmp (2) (storage_server)
camedia
        MachineName = "camedia"
        FQName = "camedia"
        MachineDescription = "PureDisk"
        MachineFlags = 0x2
        MachineNbuType = ndmp (2) (storage_server)
ownetbackup
        MachineName = "ownetbackup"
        FQName = "ownetbackup"
        MachineDescription = "PureDisk"
        MachineFlags = 0x2
        MachineNbuType = ndmp (2) (storage_server)
cymedia
        MachineName = "cymedia"
        FQName = "cymedia"
        MachineDescription = "PureDisk"
        MachineFlags = 0x2
        MachineNbuType = ndmp (2) (storage_server)
phmedia
        MachineName = "phmedia"
        FQName = "phmedia"
        MachineDescription = "PureDisk"
        MachineFlags = 0x2
        MachineNbuType = ndmp (2) (storage_server)
jkmedia
        MachineName = "jkmedia"
        FQName = "jkmedia"
        MachineDescription = "PureDisk"
        MachineFlags = 0x2
        MachineNbuType = ndmp (2) (storage_server)
apnetbackup
        MachineName = "apnetbackup"
        FQName = "apnetbackup"
        MachineDescription = "PureDisk"
        MachineFlags = 0x2
        MachineNbuType = ndmp (2) (storage_server)
ctmedia
        MachineName = "ctmedia"
        FQName = "ctmedia"
        MachineDescription = "PureDisk"
        MachineFlags = 0x2
        MachineNbuType = ndmp (2) (storage_server)
ahmedia
        MachineName = "ahmedia"
        FQName = "ahmedia"
        MachineDescription = "PureDisk"
        MachineFlags = 0x2
        MachineNbuType = ndmp (2) (storage_server)
flintmedia
        MachineName = "flintmedia"
        FQName = "flintmedia"
        MachineDescription = "PureDisk"
        MachineFlags = 0x2
        MachineNbuType = ndmp (2) (storage_server)
nbflmaster
        MachineName = "nbflmaster"
        FQName = "nbflmaster"
        MachineDescription = ""
        MachineNbuType = server (6)
Command completed successfully.

_____

getemmserver =

C:\PROGRA~1\Veritas\NetBackup\bin\admincmd>nbemmcmd -getemmserver
NBEMMCMD, Version: 7.5.0.4
These hosts were found in this domain: ahmedia, apnetbackup, camedia, ctmedia, c
wmedia, cymedia, flintmedia, jkmedia, mumedia, nbflmaster, ownetbackup, phmedia

Checking with the host "ahmedia"...
Checking with the host "apnetbackup"...
Checking with the host "camedia"...
Checking with the host "ctmedia"...
Checking with the host "cwmedia"...
Checking with the host "cymedia"...
Checking with the host "flintmedia"...
Checking with the host "jkmedia"...
Checking with the host "mumedia"...
Checking with the host "nbflmaster"...
Checking with the host "ownetbackup"...
Checking with the host "phmedia"...

Server Type    Host Version        Host Name                     EMM Server

MEDIA          7.5                 ahmedia                       nbflmaster

MEDIA          7.5                 apnetbackup                   nbflmaster

MEDIA          7.5                 camedia                       nbflmaster

MEDIA          7.5                 ctmedia                       nbflmaster

MEDIA          7.5                 cwmedia                       nbflmaster

MEDIA          7.5                 cymedia                       nbflmaster

MEDIA          7.5                 flintmedia                    nbflmaster

MEDIA          7.5                 jkmedia                       nbflmaster

MEDIA          7.5                 mumedia                       nbflmaster

MASTER         7.5                 nbflmaster                    nbflmaster

MEDIA          7.5                 ownetbackup                   nbflmaster

MEDIA          7.5                 phmedia                       nbflmaster


Command completed successfully.

C:\PROGRA~1\Veritas\NetBackup\bin\admincmd>

__________________

As background info - I have 7.5.0.4 installed on all servers / Master, except for the server in question (ahmedia) - I installed 7.5.0.6 on this. Is this my problem? Should the master be on 7.5.0.6 as well?

I restarted services on my Master and am still seeing 'ahmedia' as offline. When it comes to license keys, I only have 3 I've used and there are instances left on these keys, so it should be good to go. I can't guarentee 100% it was the same key (it might have been the other). So, uninstall 7.5.0.6 from this media server? upgrade my master?

[Marianne]

As per Version Compatibility TN, it is perfectly fine to have media server at higher point patch level. 

Try the following from cmd on the master:

nbemmcmd -updatehost -machinename <media-server> -machinestateop clr_admin_pause_and_set_active -machinetype media -masterserver <master>

check status again with 'nbemmcmd -listhosts -verbose'.

[watsons]

For

 MachineState = not active for tape or disk jobs (8)

You can also do this:

nbemmcmd -updatehost -machinename ahmedia -machinetype media -machinestateop set_master_server_connectivity -masterserver nbflmaster

[lovethatcheese]

Ok, so the command changed the status of 'ahmedia' so it is no longer 'offline' - it is now 'active for tape and disk' - however, it still only shows version 7.5 (and I installed 7.5.0.6 on this media server)

C:\PROGRA~1\Veritas\NetBackup\bin\admincmd>nbemmcmd -updatehost -machinename ahm
edia -machinestateop clr_admin_pause_and_set_active -machinetype media -masterse
rver nbflmaster
NBEMMCMD, Version: 7.5.0.4
Command completed successfully.

C:\PROGRA~1\Veritas\NetBackup\bin\admincmd>nbemmcmd -listhosts -verbose
NBEMMCMD, Version: 7.5.0.4
The following hosts were found:
mumedia
        ClusterName = ""
        MachineName = "mumedia"
        FQName = "mumedia"
        LocalDriveSeed = ""
        MachineDescription = ""
        MachineFlags = 0x17
        MachineNbuType = media (1)
        MachineState = active for tape and disk jobs (14)
        MasterServerName = "nbflmaster"
        NetBackupVersion = 7.5.0.4 (750400)
        OperatingSystem = windows (11)
        ScanAbility = 5
cymedia
        ClusterName = ""
        MachineName = "cymedia"
        FQName = "cymedia"
        LocalDriveSeed = ""
        MachineDescription = ""
        MachineFlags = 0x17
        MachineNbuType = media (1)
        MachineState = active for tape and disk jobs (14)
        MasterServerName = "nbflmaster"
        NetBackupVersion = 7.5.0.4 (750400)
        OperatingSystem = windows (11)
        ScanAbility = 5
phmedia
        ClusterName = ""
        MachineName = "phmedia"
        FQName = "phmedia"
        LocalDriveSeed = ""
        MachineDescription = ""
        MachineFlags = 0x17
        MachineNbuType = media (1)
        MachineState = active for tape and disk jobs (14)
        MasterServerName = "nbflmaster"
        NetBackupVersion = 7.5.0.4 (750400)
        OperatingSystem = windows (11)
        ScanAbility = 5
jkmedia
        ClusterName = ""
        MachineName = "jkmedia"
        FQName = "jkmedia"
        LocalDriveSeed = ""
        MachineDescription = ""
        MachineFlags = 0x17
        MachineNbuType = media (1)
        MachineState = active for tape and disk jobs (14)
        MasterServerName = "nbflmaster"
        NetBackupVersion = 7.5.0.4 (750400)
        OperatingSystem = windows (11)
        ScanAbility = 5
cwmedia
        ClusterName = ""
        MachineName = "cwmedia"
        FQName = "cwmedia"
        LocalDriveSeed = ""
        MachineDescription = ""
        MachineFlags = 0x17
        MachineNbuType = media (1)
        MachineState = active for tape and disk jobs (14)
        MasterServerName = "nbflmaster"
        NetBackupVersion = 7.5.0.4 (750400)
        OperatingSystem = windows (11)
        ScanAbility = 5
apnetbackup
        ClusterName = ""
        MachineName = "apnetbackup"
        FQName = "apnetbackup"
        LocalDriveSeed = ""
        MachineDescription = ""
        MachineFlags = 0x17
        MachineNbuType = media (1)
        MachineState = active for tape and disk jobs (14)
        MasterServerName = "nbflmaster"
        NetBackupVersion = 7.5.0.4 (750400)
        OperatingSystem = windows (11)
        ScanAbility = 5
ctmedia
        ClusterName = ""
        MachineName = "ctmedia"
        FQName = "ctmedia"
        LocalDriveSeed = ""
        MachineDescription = ""
        MachineFlags = 0x17
        MachineNbuType = media (1)
        MachineState = active for tape and disk jobs (14)
        MasterServerName = "nbflmaster"
        NetBackupVersion = 7.5.0.4 (750400)
        OperatingSystem = windows (11)
        ScanAbility = 5
camedia
        ClusterName = ""
        MachineName = "camedia"
        FQName = "camedia"
        LocalDriveSeed = ""
        MachineDescription = ""
        MachineFlags = 0x17
        MachineNbuType = media (1)
        MachineState = active for tape and disk jobs (14)
        MasterServerName = "nbflmaster"
        NetBackupVersion = 7.5.0.4 (750400)
        OperatingSystem = windows (11)
        ScanAbility = 5
ownetbackup
        ClusterName = ""
        MachineName = "ownetbackup"
        FQName = "ownetbackup"
        LocalDriveSeed = ""
        MachineDescription = ""
        MachineFlags = 0x17
        MachineNbuType = media (1)
        MachineState = active for tape and disk jobs (14)
        MasterServerName = "nbflmaster"
        NetBackupVersion = 7.5.0.4 (750400)
        OperatingSystem = windows (11)
        ScanAbility = 5
ahmedia
        ClusterName = ""
        MachineName = "ahmedia"
        FQName = "ahmedia"
        LocalDriveSeed = ""
        MachineDescription = ""
        MachineFlags = 0x17
        MachineNbuType = media (1)
        MachineState = active for tape and disk jobs (14)
        MasterServerName = "nbflmaster"
        NetBackupVersion = 7.5.0.0 (750000)
        OperatingSystem = windows (11)
        ScanAbility = 5
flintmedia
        ClusterName = ""
        MachineName = "flintmedia"
        FQName = "flintmedia"
        LocalDriveSeed = ""
        MachineDescription = ""
        MachineFlags = 0x17
        MachineNbuType = media (1)
        MachineState = active for tape and disk jobs (14)
        MasterServerName = "nbflmaster"
        NetBackupVersion = 7.5.0.4 (750400)
        OperatingSystem = windows (11)
        ScanAbility = 5
nbflmaster
        ClusterName = ""
        MachineName = "nbflmaster"
        FQName = "nbflmaster"
        GlobalDriveSeed = "VEND:#.:PROD:#.:IDX"
        LocalDriveSeed = ""
        MachineDescription = ""
        MachineFlags = 0x17
        MachineNbuType = master (3)
        MachineState = active for disk jobs (12)
        NetBackupVersion = 7.5.0.4 (750400)
        OperatingSystem = windows (11)
        ScanAbility = 5
mumedia
        MachineName = "mumedia"
        FQName = "mumedia"
        MachineDescription = "PureDisk"
        MachineFlags = 0x2
        MachineNbuType = ndmp (2) (storage_server)
camedia
        MachineName = "camedia"
        FQName = "camedia"
        MachineDescription = "PureDisk"
        MachineFlags = 0x2
        MachineNbuType = ndmp (2) (storage_server)
ownetbackup
        MachineName = "ownetbackup"
        FQName = "ownetbackup"
        MachineDescription = "PureDisk"
        MachineFlags = 0x2
        MachineNbuType = ndmp (2) (storage_server)
cymedia
        MachineName = "cymedia"
        FQName = "cymedia"
        MachineDescription = "PureDisk"
        MachineFlags = 0x2
        MachineNbuType = ndmp (2) (storage_server)
phmedia
        MachineName = "phmedia"
        FQName = "phmedia"
        MachineDescription = "PureDisk"
        MachineFlags = 0x2
        MachineNbuType = ndmp (2) (storage_server)
jkmedia
        MachineName = "jkmedia"
        FQName = "jkmedia"
        MachineDescription = "PureDisk"
        MachineFlags = 0x2
        MachineNbuType = ndmp (2) (storage_server)
apnetbackup
        MachineName = "apnetbackup"
        FQName = "apnetbackup"
        MachineDescription = "PureDisk"
        MachineFlags = 0x2
        MachineNbuType = ndmp (2) (storage_server)
ctmedia
        MachineName = "ctmedia"
        FQName = "ctmedia"
        MachineDescription = "PureDisk"
        MachineFlags = 0x2
        MachineNbuType = ndmp (2) (storage_server)
ahmedia
        MachineName = "ahmedia"
        FQName = "ahmedia"
        MachineDescription = "PureDisk"
        MachineFlags = 0x2
        MachineNbuType = ndmp (2) (storage_server)
flintmedia
        MachineName = "flintmedia"
        FQName = "flintmedia"
        MachineDescription = "PureDisk"
        MachineFlags = 0x2
        MachineNbuType = ndmp (2) (storage_server)
nbflmaster
        MachineName = "nbflmaster"
        FQName = "nbflmaster"
        MachineDescription = ""
        MachineNbuType = server (6)
Command completed successfully.

C:\PROGRA~1\Veritas\NetBackup\bin\admincmd>

So, I tried to run the device configuration on this media server, and it fails when trying to detect devices. So we made some progress, but I'm not sure where to go now. The media server has the exact network info as before, and all ports are open on firewall (applied same kaspersky firewall policy it had before).

This media server has a tape drive attached locally via SAS, and is connected to an equal logic san as it was before. The drive is mapped and has same drive letter as before as well.

Under 'host properties' for this media server, I get 'cannot connect on socket (25)'.

[lovethatcheese]

I've been tinkering around with this common status 25 error now -

from the media server in question:

C:\PROGRA~1\Veritas\NetBackup\bin\admincmd>bptestbpcd -verbose
1 0 2
10.xx.xx.39:50005 -> 10.xx.xx.39:13782
10.xx.xx.39:1294 <- 10.xx.xx.39:50006
PEER_NAME = ahmedia
HOST_NAME = ahmedia
CLIENT_NAME = ahmedia
VERSION = 0x07500004
PLATFORM = win_x64
PATCH_VERSION = 7.5.0.6
SERVER_PATCH_VERSION = 7.5.0.6
MASTER_SERVER = nbflmaster
EMM_SERVER = nbflmaster
NB_MACHINE_TYPE = MEDIA_SERVER

C:\PROGRA~1\Veritas\NetBackup\bin\admincmd>cd ..

C:\PROGRA~1\Veritas\NetBackup\bin>bpclntcmd -self
gethostname() returned: ahmedia
host ahmedia: ahmedia at 10.xx.xx.39
aliases:     ahmedia     10.xx.xx.39

C:\PROGRA~1\Veritas\NetBackup\bin>

I can ping the master from media server, and my media server is matching my other, working media servers....I think i'm overlooking something.

[lovethatcheese]

I must be overlooking something.....unless -

One service is not starting on this media server -

C:\PROGRA~1\Veritas\NetBackup\bin>bpup -v -f

NetBackup 7.5 -- Startup Utility

Starting services
> NetBackup Legacy Network Service
> NetBackup Legacy Network Service -- STARTED
> NetBackup Legacy Client Service
> NetBackup Legacy Client Service -- STARTED
> NetBackup Client Service
> NetBackup Client Service -- STARTED
> NetBackup SAN Client Fibre Transport Service
> NetBackup SAN Client Fibre Transport Service -- DISABLED
> NetBackup Event Manager
> NetBackup Event Manager -- DISABLED
> NetBackup Volume Manager
> NetBackup Volume Manager -- NOT STARTED
> NetBackup Device Manager
> NetBackup Device Manager -- NOT STARTED
> NetBackup Remote Manager and Monitor Service
> NetBackup Remote Manager and Monitor Service -- NOT STARTED
> NetBackup Deduplication Manager
> NetBackup Deduplication Manager -- DISABLED
> NetBackup Deduplication Engine
> NetBackup Deduplication Engine -- DISABLED
> NetBackup CloudStore Service Container
> NetBackup CloudStore Service Container -- STARTED
> NetBackup Authentication
> NetBackup Authentication -- DISABLED
> NetBackup Authorization
> NetBackup Authorization -- DISABLED
> NetBackup Compatibility Service
> NetBackup Compatibility Service -- STARTED
> NetBackup Request Daemon
> NetBackup Request Daemon -- DISABLED
> NetBackup Job Manager
> NetBackup Job Manager -- DISABLED
> NetBackup Policy Execution Manager
> NetBackup Policy Execution Manager -- DISABLED
> NetBackup Service Layer
> NetBackup Service Layer -- STARTED
> NetBackup Vault Manager
> NetBackup Vault Manager -- DISABLED
> NetBackup Storage Lifecycle Manager
> NetBackup Storage Lifecycle Manager -- DISABLED
> NetBackup Service Monitor
> NetBackup Service Monitor -- NOT STARTED
> NetBackup Indexing Manager
> NetBackup Indexing Manager -- DISABLED
> NetBackup Bare Metal Restore Boot Server
> NetBackup Bare Metal Restore Boot Server -- STARTED
Start up of one or more services failed.

C:\PROGRA~1\Veritas\NetBackup\bin>

Any ideas here?

[watsons]

What did nbrmms logs (OID=222) tell us? Can you enable that?

[Marianne]

Please create bpcd log folder on the media server, then do bptestbpcd from master to media server:

bptestbpcd -host ahmedia -debug -verbose

Post output as well bpcd log.

[lovethatcheese]

C:\PROGRA~1\Veritas\NetBackup\bin\admincmd>bptestbpcd -host ahmedia -debug -verb
ose
22:58:19.973 [2100.3964] <2> bptestbpcd: VERBOSE = 2
22:58:19.988 [2100.3964] <2> vnet_pbxConnect: pbxConnectEx Succeeded
22:58:19.988 [2100.3964] <2> logconnections: BPCD CONNECT FROM 10.8.32.42.50966
TO 10.24.32.39.1556 fd = 440
22:58:20.019 [2100.3964] <2> vnet_pbxConnect: pbxConnectEx Succeeded
22:58:20.035 [2100.3964] <8> do_pbx_service: [vnet_connect.c:2108] via PBX VNETD
 CONNECT FROM 10.8.32.42.50967 TO 10.24.32.39.1556 fd = 468
22:58:20.035 [2100.3964] <8> vnet_vnetd_connect_forward_socket_begin: [vnet_vnet
d.c:443] VN_REQUEST_CONNECT_FORWARD_SOCKET 10 0xa
22:58:20.253 [2100.3964] <8> vnet_vnetd_connect_forward_socket_begin: [vnet_vnet
d.c:460] ipc_string 51730
1 1 1
10.8.32.42:50966 -> 10.24.32.39:1556
10.8.32.42:50967 -> 10.24.32.39:1556
22:58:20.909 [2100.3964] <8> file_to_cache_item: [vnet_addrinfo.c:6555] fopen()
failed ERRNO=2 FILE=C:\Program Files\Veritas\NetBackup\var\host_cache\1ff\ffffff
ff+vnetd,1,1,0,1,0+.txt
22:58:21.127 [2100.3964] <2> bpcr_get_peername_rqst: Server peername length = 10

22:58:21.330 [2100.3964] <2> bpcr_get_hostname_rqst: Server hostname length = 7
22:58:21.533 [2100.3964] <2> bpcr_get_clientname_rqst: Server clientname length
= 7
22:58:21.735 [2100.3964] <2> bpcr_get_version_rqst: bpcd version: 07500004
22:58:21.938 [2100.3964] <2> bpcr_get_platform_rqst: Server platform length = 7
22:58:22.157 [2100.3964] <2> bpcr_get_version_rqst: bpcd version: 07500004
22:58:22.406 [2100.3964] <2> bpcr_patch_version_rqst: theRest == > <
22:58:22.406 [2100.3964] <2> bpcr_get_version_rqst: bpcd version: 07500004
22:58:22.827 [2100.3964] <2> bpcr_patch_version_rqst: theRest == > <
22:58:22.827 [2100.3964] <2> bpcr_get_version_rqst: bpcd version: 07500004
PEER_NAME = nbflmaster
HOST_NAME = ahmedia
CLIENT_NAME = ahmedia
VERSION = 0x07500004
PLATFORM = win_x64
PATCH_VERSION = 7.5.0.6
SERVER_PATCH_VERSION = 7.5.0.6
MASTER_SERVER = nbflmaster
EMM_SERVER = nbflmaster
NB_MACHINE_TYPE = MEDIA_SERVER
<2>bptestbpcd: EXIT status = 0
22:58:23.280 [2100.3964] <2> bptestbpcd: EXIT status = 0

C:\PROGRA~1\Veritas\NetBackup\bin\admincmd>

__________________________________________________

Log -

22:58:21.632 [2904.3404] <2> setup_debug_log: switched debug log file for bpcd
22:58:21.632 [2904.3404] <2> bpcd main: VERBOSE = 0
22:58:21.632 [2904.3404] <2> logparams: C:\Program Files\Veritas\NetBackup\bin\bpcd.exe -standalone
22:58:21.632 [2904.3404] <2> process_requests: offset to GMT 28800
22:58:21.632 [2904.3404] <2> logconnections: BPCD ACCEPT FROM 10.8.32.42.50966 TO 10.24.32.39.1556 fd = 480
22:58:21.632 [2904.3404] <2> process_requests: setup_sockopts complete
22:58:21.632 [2904.3404] <2> bpcd peer_hostname: Connection from host nbflmaster (10.8.32.42) port 50966
22:58:21.632 [2904.3404] <2> bpcd valid_server: comparing nbflmaster and nbflmaster
22:58:21.632 [2904.3404] <4> bpcd valid_server: hostname comparison succeeded
22:58:21.819 [2904.3404] <2> process_requests: output socket port number = 1
22:58:22.303 [2904.3404] <8> vnet_cached_getaddrinfo_and_update: [vnet_addrinfo.c:1585] in failed file cache ERR=10109 NAME=NULL SVC=testdaemon
22:58:22.303 [2904.3404] <8> vnet_cached_get_service_port: [vnet_addrinfo.c:2396] vnet_cached_getaddrinfo failed STAT=6 RV=10109 NAME=testdaemon
22:58:22.303 [2904.3404] <8> is_pbxable_service: [vnet_connect.c:2159] vnet_cached_get_service_port() failed 6 0x6
22:58:22.303 [2904.3404] <8> is_pbxable_service: [vnet_connect.c:2160] service 51730
22:58:22.303 [2904.3404] <8> file_to_cache_item: [vnet_addrinfo.c:6574] fopen() failed ERRNO=2 FILE=C:\Program Files\Veritas\NetBackup\var\host_cache\14f\6cf9fd4f+51730,1,400,2,1,0+127.0.0.1.txt
22:58:22.303 [2904.3404] <8> verify_hashes: [vnet_vnetd.c:1641] hash_str a725de7624d42813427c53d62e025cb4
22:58:22.318 [2904.3404] <2> process_requests: Duplicated vnetd socket on stderr
22:58:22.318 [2904.3404] <2> process_requests: <---- NetBackup 7.5 0 ------------initiated
22:58:22.318 [2904.3404] <2> process_requests: VERBOSE = 0
22:58:22.318 [2904.3404] <2> process_requests: Not using VxSS authentication with nbflmaster
22:58:22.521 [2904.3404] <2> process_requests: BPCD_PEERNAME_RQST
22:58:22.521 [2904.3404] <2> bpcd peer_hostname: Connection from host nbflmaster (10.8.32.42) port 50966
22:58:22.740 [2904.3404] <2> process_requests: BPCD_HOSTNAME_RQST
22:58:22.958 [2904.3404] <2> process_requests: BPCD_CLIENTNAME_RQST
22:58:23.161 [2904.3404] <2> process_requests: BPCD_GET_VERSION_RQST
22:58:23.379 [2904.3404] <2> process_requests: BPCD_GET_PLATFORM_RQST
22:58:23.598 [2904.3404] <2> process_requests: BPCD_GET_VERSION_RQST
22:58:23.800 [2904.3404] <2> process_requests: BPCD_PATCH_VERSION_RQST
22:58:23.800 [2904.3404] <2> retrieveLocalPatchVersion: Reading from C:\Program Files\Veritas\NetBackup\bin\version.txt
22:58:23.800 [2904.3404] <2> parsePatchVersionString: parsing = >7.5.0.6
<
22:58:23.800 [2904.3404] <2> parsePatchVersionString: theRest = ><
22:58:24.019 [2904.3404] <2> process_requests: BPCD_GET_VERSION_RQST
22:58:24.222 [2904.3404] <2> process_requests: BPCD_PATCH_VERSION_RQST
22:58:24.222 [2904.3404] <2> retrieveLocalPatchVersion: Reading from C:\Program Files\Veritas\NetBackup\version.txt
22:58:24.222 [2904.3404] <2> parsePatchVersionString: parsing = >7.5.0.6
<
22:58:24.222 [2904.3404] <2> parsePatchVersionString: theRest = ><
22:58:24.440 [2904.3404] <2> process_requests: BPCD_GET_VERSION_RQST
22:58:24.658 [2904.3404] <2> process_requests: BPCD_READ_HOST_CONFIG_RQST
22:58:24.892 [2904.3404] <2> process_requests: BPCD_DISCONNECT_RQST
22:58:24.892 [2904.3404] <2> bpcd exit_bpcd: exit status 0  ----------->exiting
 

[Marianne · Accepted solution]

OK, so bptestbpcd connects successfully to media server on port 1556.

The GUI is probably using a different port number - 13782 or 13724?

Is anything logged in bpcd when the GUI connection fails?

About services not starting - my problem is with this one:

> NetBackup Volume Manager
> NetBackup Volume Manager -- NOT STARTED

This is why you cannot add devices. Please double-check license keys installed on this media server. 
If you do not have capacity license, you need Enterprise Server license as well as Library Based Tape Drive license.

If you have correct licenses installed, please add VERBOSE entry in ...\volmgr\vm.conf and try again to stop/start services. 
If Volume Manager still does not start, please check Event Viewer System and Application logs.

[lovethatcheese]

Log from connecting to media server host through GUI -

3580] <2> bpcd exit_bpcd: exit status 0  ----------->exiting
09:42:30.341 [3436.1096] <2> vnet_pbxAcceptSocket: Accepted sock[476] from 10.8.32.42:64466
09:42:30.341 [3436.1096] <2> bpcd main: accept sock = 476
09:42:30.357 [2500.2364] <2> setup_debug_log: switched debug log file for bpcd
09:42:30.357 [2500.2364] <2> bpcd main: VERBOSE = 0
09:42:30.357 [2500.2364] <2> logparams: C:\Program Files\Veritas\NetBackup\bin\bpcd.exe -standalone
09:42:30.357 [2500.2364] <2> process_requests: offset to GMT 28800
09:42:30.372 [2500.2364] <2> logconnections: BPCD ACCEPT FROM 10.8.32.42.64466 TO 10.24.32.39.1556 fd = 476
09:42:30.372 [2500.2364] <2> process_requests: setup_sockopts complete
09:42:30.372 [2500.2364] <2> bpcd peer_hostname: Connection from host nbflmaster (10.8.32.42) port 64466
09:42:30.372 [2500.2364] <2> bpcd valid_server: comparing nbflmaster and nbflmaster
09:42:30.372 [2500.2364] <4> bpcd valid_server: hostname comparison succeeded
09:42:30.559 [2500.2364] <2> process_requests: output socket port number = 1
09:42:31.012 [2500.2364] <8> vnet_cached_getaddrinfo_and_update: [vnet_addrinfo.c:1585] in failed file cache ERR=10109 NAME=NULL SVC=testdaemon
09:42:31.012 [2500.2364] <8> vnet_cached_get_service_port: [vnet_addrinfo.c:2396] vnet_cached_getaddrinfo failed STAT=6 RV=10109 NAME=testdaemon
09:42:31.012 [2500.2364] <8> is_pbxable_service: [vnet_connect.c:2159] vnet_cached_get_service_port() failed 6 0x6
09:42:31.012 [2500.2364] <8> is_pbxable_service: [vnet_connect.c:2160] service 53725
09:42:31.012 [2500.2364] <8> file_to_cache_item: [vnet_addrinfo.c:6574] fopen() failed ERRNO=2 FILE=C:\Program Files\Veritas\NetBackup\var\host_cache\14f\6cf9fd4f+53725,1,400,2,1,0+127.0.0.1.txt
09:42:31.012 [2500.2364] <8> verify_hashes: [vnet_vnetd.c:1641] hash_str 35f37a1b9b2a2cb2065900d525dd6b7c
09:42:31.012 [2500.2364] <2> process_requests: Duplicated vnetd socket on stderr
09:42:31.012 [2500.2364] <2> process_requests: <---- NetBackup 7.5 0 ------------initiated
09:42:31.012 [2500.2364] <2> process_requests: VERBOSE = 0
09:42:31.012 [2500.2364] <2> process_requests: Not using VxSS authentication with nbflmaster
09:42:31.246 [2500.2364] <2> process_requests: BPCD_FORK_CMD_RQST
09:42:31.449 [2500.2364] <2> process_requests: fork cmd = /usr/openv/netbackup/bin/bptm bptm -rptdrv -jobid -1374244253 -jm
09:42:31.449 [2500.2364] <2> process_requests: filter type = -1
09:42:31.449 [2500.2364] <2> process_requests: Convert args to CreateProcess format
09:42:31.449 [2500.2364] <2> process_requests: Done converting args to CreateProcess format
09:42:31.449 [2500.2364] <2> process_requests: new fork cmd = C:\Program Files\Veritas\NetBackup\bin\bptm.exe -rptdrv -jobid -1374244253 -jm
09:42:31.449 [2500.2364] <2> process_requests: Before CreateProcess
09:42:31.449 [2500.2364] <2> process_requests: StdOutput assigned the value STDOUTSOCK
09:42:31.449 [2500.2364] <2> process_requests: final fork cmd = "C:\Program Files\Veritas\NetBackup\bin\bptm.exe" -rptdrv -jobid -1374244253 -jm
09:42:31.449 [2500.2364] <2> process_requests: After CreateProcess, pid = 3676
09:42:31.480 [2500.2364] <2> bpcd exit_bpcd: exit status 0  ----------->exiting
09:52:30.256 [3436.1096] <2> vnet_pbxAcceptSocket: Accepted sock[476] from 10.8.32.42:64664
09:52:30.256 [3436.1096] <2> bpcd main: accept sock = 476
09:52:30.287 [3164.2844] <2> setup_debug_log: switched debug log file for bpcd
09:52:30.287 [3164.2844] <2> bpcd main: VERBOSE = 0
09:52:30.287 [3164.2844] <2> logparams: C:\Program Files\Veritas\NetBackup\bin\bpcd.exe -standalone
09:52:30.287 [3164.2844] <2> process_requests: offset to GMT 28800
09:52:30.303 [3164.2844] <2> logconnections: BPCD ACCEPT FROM 10.8.32.42.64664 TO 10.24.32.39.1556 fd = 476
09:52:30.303 [3164.2844] <2> process_requests: setup_sockopts complete
09:52:30.303 [3164.2844] <2> bpcd peer_hostname: Connection from host nbflmaster (10.8.32.42) port 64664
09:52:30.303 [3164.2844] <2> bpcd valid_server: comparing nbflmaster and nbflmaster
09:52:30.303 [3164.2844] <4> bpcd valid_server: hostname comparison succeeded
09:52:30.474 [3164.2844] <2> process_requests: output socket port number = 1
09:52:30.942 [3164.2844] <8> vnet_cached_getaddrinfo_and_update: [vnet_addrinfo.c:1585] in failed file cache ERR=10109 NAME=NULL SVC=testdaemon
09:52:30.942 [3164.2844] <8> vnet_cached_get_service_port: [vnet_addrinfo.c:2396] vnet_cached_getaddrinfo failed STAT=6 RV=10109 NAME=testdaemon
09:52:30.942 [3164.2844] <8> is_pbxable_service: [vnet_connect.c:2159] vnet_cached_get_service_port() failed 6 0x6
09:52:30.942 [3164.2844] <8> is_pbxable_service: [vnet_connect.c:2160] service 53758
09:52:30.942 [3164.2844] <8> file_to_cache_item: [vnet_addrinfo.c:6574] fopen() failed ERRNO=2 FILE=C:\Program Files\Veritas\NetBackup\var\host_cache\14f\6cf9fd4f+53758,1,400,2,1,0+127.0.0.1.txt
09:52:30.942 [3164.2844] <8> verify_hashes: [vnet_vnetd.c:1641] hash_str 27921216e3ebe6e537986aa14a92b7d5
09:52:30.958 [3164.2844] <2> process_requests: Duplicated vnetd socket on stderr
09:52:30.958 [3164.2844] <2> process_requests: <---- NetBackup 7.5 0 ------------initiated
09:52:30.958 [3164.2844] <2> process_requests: VERBOSE = 0
09:52:30.958 [3164.2844] <2> process_requests: Not using VxSS authentication with nbflmaster
09:52:31.161 [3164.2844] <2> process_requests: BPCD_FORK_CMD_RQST
09:52:31.379 [3164.2844] <2> process_requests: fork cmd = /usr/openv/netbackup/bin/bptm bptm -rptdrv -jobid -1374244265 -jm
09:52:31.379 [3164.2844] <2> process_requests: filter type = -1
09:52:31.379 [3164.2844] <2> process_requests: Convert args to CreateProcess format
09:52:31.379 [3164.2844] <2> process_requests: Done converting args to CreateProcess format
09:52:31.379 [3164.2844] <2> process_requests: new fork cmd = C:\Program Files\Veritas\NetBackup\bin\bptm.exe -rptdrv -jobid -1374244265 -jm
09:52:31.379 [3164.2844] <2> process_requests: Before CreateProcess
09:52:31.379 [3164.2844] <2> process_requests: StdOutput assigned the value STDOUTSOCK
09:52:31.379 [3164.2844] <2> process_requests: final fork cmd = "C:\Program Files\Veritas\NetBackup\bin\bptm.exe" -rptdrv -jobid -1374244265 -jm
09:52:31.379 [3164.2844] <2> process_requests: After CreateProcess, pid = 1448
09:52:31.379 [3164.2844] <2> bpcd exit_bpcd: exit status 0  ----------->exiting
10:02:30.280 [3436.1096] <2> vnet_pbxAcceptSocket: Accepted sock[476] from 10.8.32.42:64862
10:02:30.280 [3436.1096] <2> bpcd main: accept sock = 476
10:02:30.311 [1376.1268] <2> setup_debug_log: switched debug log file for bpcd
10:02:30.311 [1376.1268] <2> bpcd main: VERBOSE = 0
10:02:30.311 [1376.1268] <2> logparams: C:\Program Files\Veritas\NetBackup\bin\bpcd.exe -standalone
10:02:30.311 [1376.1268] <2> process_requests: offset to GMT 28800
10:02:30.326 [1376.1268] <2> logconnections: BPCD ACCEPT FROM 10.8.32.42.64862 TO 10.24.32.39.1556 fd = 476
10:02:30.326 [1376.1268] <2> process_requests: setup_sockopts complete
10:02:30.326 [1376.1268] <2> bpcd peer_hostname: Connection from host nbflmaster (10.8.32.42) port 64862
10:02:30.326 [1376.1268] <2> bpcd valid_server: comparing nbflmaster and nbflmaster
10:02:30.326 [1376.1268] <4> bpcd valid_server: hostname comparison succeeded
10:02:30.498 [1376.1268] <2> process_requests: output socket port number = 1
10:02:31.060 [1376.1268] <8> vnet_cached_getaddrinfo_and_update: [vnet_addrinfo.c:1585] in failed file cache ERR=10109 NAME=NULL SVC=testdaemon
10:02:31.060 [1376.1268] <8> vnet_cached_get_service_port: [vnet_addrinfo.c:2396] vnet_cached_getaddrinfo failed STAT=6 RV=10109 NAME=testdaemon
10:02:31.060 [1376.1268] <8> is_pbxable_service: [vnet_connect.c:2159] vnet_cached_get_service_port() failed 6 0x6
10:02:31.060 [1376.1268] <8> is_pbxable_service: [vnet_connect.c:2160] service 53798
10:02:31.060 [1376.1268] <8> file_to_cache_item: [vnet_addrinfo.c:6574] fopen() failed ERRNO=2 FILE=C:\Program Files\Veritas\NetBackup\var\host_cache\14f\6cf9fd4f+53798,1,400,2,1,0+127.0.0.1.txt
10:02:31.060 [1376.1268] <8> verify_hashes: [vnet_vnetd.c:1641] hash_str 23380f49fab5736517c364bc2bbfb131
10:02:31.075 [1376.1268] <2> process_requests: Duplicated vnetd socket on stderr
10:02:31.075 [1376.1268] <2> process_requests: <---- NetBackup 7.5 0 ------------initiated
10:02:31.075 [1376.1268] <2> process_requests: VERBOSE = 0
10:02:31.075 [1376.1268] <2> process_requests: Not using VxSS authentication with nbflmaster
10:02:31.278 [1376.1268] <2> process_requests: BPCD_FORK_CMD_RQST
10:02:31.496 [1376.1268] <2> process_requests: fork cmd = /usr/openv/netbackup/bin/bptm bptm -rptdrv -jobid -1374244277 -jm
10:02:31.496 [1376.1268] <2> process_requests: filter type = -1
10:02:31.496 [1376.1268] <2> process_requests: Convert args to CreateProcess format
10:02:31.496 [1376.1268] <2> process_requests: Done converting args to CreateProcess format
10:02:31.496 [1376.1268] <2> process_requests: new fork cmd = C:\Program Files\Veritas\NetBackup\bin\bptm.exe -rptdrv -jobid -1374244277 -jm
10:02:31.496 [1376.1268] <2> process_requests: Before CreateProcess
10:02:31.496 [1376.1268] <2> process_requests: StdOutput assigned the value STDOUTSOCK
10:02:31.496 [1376.1268] <2> process_requests: final fork cmd = "C:\Program Files\Veritas\NetBackup\bin\bptm.exe" -rptdrv -jobid -1374244277 -jm
10:02:31.496 [1376.1268] <2> process_requests: After CreateProcess, pid = 1824
10:02:31.496 [1376.1268] <2> bpcd exit_bpcd: exit status 0  ----------->exiting
10:12:30.272 [3436.1096] <2> vnet_pbxAcceptSocket: Accepted sock[472] from 10.8.32.42:65074
10:12:30.272 [3436.1096] <2> bpcd main: accept sock = 472
10:12:30.303 [3536.2496] <2> setup_debug_log: switched debug log file for bpcd
10:12:30.303 [3536.2496] <2> bpcd main: VERBOSE = 0
10:12:30.303 [3536.2496] <2> logparams: C:\Program Files\Veritas\NetBackup\bin\bpcd.exe -standalone
10:12:30.303 [3536.2496] <2> process_requests: offset to GMT 28800
10:12:30.303 [3536.2496] <2> logconnections: BPCD ACCEPT FROM 10.8.32.42.65074 TO 10.24.32.39.1556 fd = 472
10:12:30.303 [3536.2496] <2> process_requests: setup_sockopts complete
10:12:30.303 [3536.2496] <2> bpcd peer_hostname: Connection from host nbflmaster (10.8.32.42) port 65074
10:12:30.303 [3536.2496] <2> bpcd valid_server: comparing nbflmaster and nbflmaster
10:12:30.303 [3536.2496] <4> bpcd valid_server: hostname comparison succeeded
10:12:30.491 [3536.2496] <2> process_requests: output socket port number = 1
10:12:30.959 [3536.2496] <8> vnet_cached_getaddrinfo_and_update: [vnet_addrinfo.c:1585] in failed file cache ERR=10109 NAME=NULL SVC=testdaemon
10:12:30.959 [3536.2496] <8> vnet_cached_get_service_port: [vnet_addrinfo.c:2396] vnet_cached_getaddrinfo failed STAT=6 RV=10109 NAME=testdaemon
10:12:30.959 [3536.2496] <8> is_pbxable_service: [vnet_connect.c:2159] vnet_cached_get_service_port() failed 6 0x6
10:12:30.959 [3536.2496] <8> is_pbxable_service: [vnet_connect.c:2160] service 53833
10:12:30.959 [3536.2496] <8> file_to_cache_item: [vnet_addrinfo.c:6574] fopen() failed ERRNO=2 FILE=C:\Program Files\Veritas\NetBackup\var\host_cache\14f\6cf9fd4f+53833,1,400,2,1,0+127.0.0.1.txt
10:12:30.990 [3536.2496] <8> verify_hashes: [vnet_vnetd.c:1641] hash_str 86ee2373f5e4887c583529d52f1813f5
10:12:30.990 [3536.2496] <2> process_requests: Duplicated vnetd socket on stderr
10:12:30.990 [3536.2496] <2> process_requests: <---- NetBackup 7.5 0 ------------initiated
10:12:30.990 [3536.2496] <2> process_requests: VERBOSE = 0
10:12:30.990 [3536.2496] <2> process_requests: Not using VxSS authentication with nbflmaster
10:12:31.177 [3536.2496] <2> process_requests: BPCD_FORK_CMD_RQST
10:12:31.395 [3536.2496] <2> process_requests: fork cmd = /usr/openv/netbackup/bin/bptm bptm -rptdrv -jobid -1374244289 -jm
10:12:31.395 [3536.2496] <2> process_requests: filter type = -1
10:12:31.395 [3536.2496] <2> process_requests: Convert args to CreateProcess format
10:12:31.395 [3536.2496] <2> process_requests: Done converting args to CreateProcess format
10:12:31.395 [3536.2496] <2> process_requests: new fork cmd = C:\Program Files\Veritas\NetBackup\bin\bptm.exe -rptdrv -jobid -1374244289 -jm
10:12:31.395 [3536.2496] <2> process_requests: Before CreateProcess
10:12:31.395 [3536.2496] <2> process_requests: StdOutput assigned the value STDOUTSOCK
10:12:31.395 [3536.2496] <2> process_requests: final fork cmd = "C:\Program Files\Veritas\NetBackup\bin\bptm.exe" -rptdrv -jobid -1374244289 -jm
10:12:31.395 [3536.2496] <2> process_requests: After CreateProcess, pid = 3756
10:12:31.395 [3536.2496] <2> bpcd exit_bpcd: exit status 0  ----------->exiting
10:22:30.234 [3436.1096] <2> vnet_pbxAcceptSocket: Accepted sock[476] from 10.8.32.42:65272
10:22:30.234 [3436.1096] <2> bpcd main: accept sock = 476
10:22:30.265 [3708.660] <2> setup_debug_log: switched debug log file for bpcd
10:22:30.265 [3708.660] <2> bpcd main: VERBOSE = 0
10:22:30.265 [3708.660] <2> logparams: C:\Program Files\Veritas\NetBackup\bin\bpcd.exe -standalone
10:22:30.265 [3708.660] <2> process_requests: offset to GMT 28800
10:22:30.265 [3708.660] <2> logconnections: BPCD ACCEPT FROM 10.8.32.42.65272 TO 10.24.32.39.1556 fd = 476
10:22:30.265 [3708.660] <2> process_requests: setup_sockopts complete
10:22:30.265 [3708.660] <2> bpcd peer_hostname: Connection from host nbflmaster (10.8.32.42) port 65272
10:22:30.265 [3708.660] <2> bpcd valid_server: comparing nbflmaster and nbflmaster
10:22:30.265 [3708.660] <4> bpcd valid_server: hostname comparison succeeded
10:22:30.452 [3708.660] <2> process_requests: output socket port number = 1
10:22:30.983 [3708.660] <8> file_to_cache_item: [vnet_addrinfo.c:6574] fopen() failed ERRNO=2 FILE=C:\Program Files\Veritas\NetBackup\var\host_cache\1ff\ffffffff+testdaemon,1,1,0,1,0+.txt
10:22:30.983 [3708.660] <8> vnet_cached_get_service_port: [vnet_addrinfo.c:2396] vnet_cached_getaddrinfo failed STAT=6 RV=10109 NAME=testdaemon
10:22:30.983 [3708.660] <8> is_pbxable_service: [vnet_connect.c:2159] vnet_cached_get_service_port() failed 6 0x6
10:22:30.983 [3708.660] <8> is_pbxable_service: [vnet_connect.c:2160] service 53878
10:22:30.983 [3708.660] <8> file_to_cache_item: [vnet_addrinfo.c:6574] fopen() failed ERRNO=2 FILE=C:\Program Files\Veritas\NetBackup\var\host_cache\14f\6cf9fd4f+53878,1,400,2,1,0+127.0.0.1.txt
10:22:30.983 [3708.660] <8> verify_hashes: [vnet_vnetd.c:1641] hash_str c4d9d85aeeeccb95f38f2efbf6fb7496
10:22:30.998 [3708.660] <2> process_requests: Duplicated vnetd socket on stderr
10:22:30.998 [3708.660] <2> process_requests: <---- NetBackup 7.5 0 ------------initiated
10:22:30.998 [3708.660] <2> process_requests: VERBOSE = 0
10:22:30.998 [3708.660] <2> process_requests: Not using VxSS authentication with nbflmaster
10:22:31.217 [3708.660] <2> process_requests: BPCD_FORK_CMD_RQST
10:22:31.435 [3708.660] <2> process_requests: fork cmd = /usr/openv/netbackup/bin/bptm bptm -rptdrv -jobid -1374244301 -jm
10:22:31.435 [3708.660] <2> process_requests: filter type = -1
10:22:31.435 [3708.660] <2> process_requests: Convert args to CreateProcess format
10:22:31.435 [3708.660] <2> process_requests: Done converting args to CreateProcess format
10:22:31.435 [3708.660] <2> process_requests: new fork cmd = C:\Program Files\Veritas\NetBackup\bin\bptm.exe -rptdrv -jobid -1374244301 -jm
10:22:31.435 [3708.660] <2> process_requests: Before CreateProcess
10:22:31.435 [3708.660] <2> process_requests: StdOutput assigned the value STDOUTSOCK
10:22:31.435 [3708.660] <2> process_requests: final fork cmd = "C:\Program Files\Veritas\NetBackup\bin\bptm.exe" -rptdrv -jobid -1374244301 -jm
10:22:31.435 [3708.660] <2> process_requests: After CreateProcess, pid = 3840
10:22:31.435 [3708.660] <2> bpcd exit_bpcd: exit status 0  ----------->exiting
10:26:21.489 [3436.1096] <2> vnet_pbxAcceptSocket: Accepted sock[484] from 10.8.32.42:65370
10:26:21.489 [3436.1096] <2> bpcd main: accept sock = 484
10:26:21.504 [1236.1680] <2> setup_debug_log: switched debug log file for bpcd
10:26:21.504 [1236.1680] <2> bpcd main: VERBOSE = 0
10:26:21.504 [1236.1680] <2> logparams: C:\Program Files\Veritas\NetBackup\bin\bpcd.exe -standalone
10:26:21.504 [1236.1680] <2> process_requests: offset to GMT 28800
10:26:21.520 [1236.1680] <2> logconnections: BPCD ACCEPT FROM 10.8.32.42.65370 TO 10.24.32.39.1556 fd = 484
10:26:21.520 [1236.1680] <2> process_requests: setup_sockopts complete
10:26:21.520 [1236.1680] <2> bpcd peer_hostname: Connection from host nbflmaster (10.8.32.42) port 65370
10:26:21.520 [1236.1680] <2> bpcd valid_server: comparing nbflmaster and nbflmaster
10:26:21.520 [1236.1680] <4> bpcd valid_server: hostname comparison succeeded
10:26:21.691 [1236.1680] <2> process_requests: output socket port number = 1
10:26:22.191 [1236.1680] <8> vnet_cached_getaddrinfo_and_update: [vnet_addrinfo.c:1585] in failed file cache ERR=10109 NAME=NULL SVC=testdaemon
10:26:22.191 [1236.1680] <8> vnet_cached_get_service_port: [vnet_addrinfo.c:2396] vnet_cached_getaddrinfo failed STAT=6 RV=10109 NAME=testdaemon
10:26:22.191 [1236.1680] <8> is_pbxable_service: [vnet_connect.c:2159] vnet_cached_get_service_port() failed 6 0x6
10:26:22.191 [1236.1680] <8> is_pbxable_service: [vnet_connect.c:2160] service 53890
10:26:22.191 [1236.1680] <8> file_to_cache_item: [vnet_addrinfo.c:6574] fopen() failed ERRNO=2 FILE=C:\Program Files\Veritas\NetBackup\var\host_cache\14f\6cf9fd4f+53890,1,400,2,1,0+127.0.0.1.txt
10:26:22.191 [1236.1680] <8> verify_hashes: [vnet_vnetd.c:1641] hash_str 895c964e4e07e26a45e148e77b67a6f2
10:26:22.206 [1236.1680] <2> process_requests: Duplicated vnetd socket on stderr
10:26:22.206 [1236.1680] <2> process_requests: <---- NetBackup 7.5 0 ------------initiated
10:26:22.206 [1236.1680] <2> process_requests: VERBOSE = 0
10:26:22.206 [1236.1680] <2> process_requests: Not using VxSS authentication with nbflmaster
10:26:22.409 [1236.1680] <2> process_requests: BPCD_GET_VERSION_RQST
10:26:22.612 [1236.1680] <2> process_requests: BPCD_READ_HOST_CONFIG_RQST
10:26:23.064 [1236.1680] <2> process_requests: BPCD_DISCONNECT_RQST
10:26:23.064 [1236.1680] <2> bpcd exit_bpcd: exit status 0  ----------->exiting
10:26:31.254 [3436.1096] <2> vnet_pbxAcceptSocket: Accepted sock[484] from 10.8.32.42:65377
10:26:31.254 [3436.1096] <2> bpcd main: accept sock = 484
10:26:31.270 [1328.1668] <2> setup_debug_log: switched debug log file for bpcd
10:26:31.270 [1328.1668] <2> bpcd main: VERBOSE = 0
10:26:31.270 [1328.1668] <2> logparams: C:\Program Files\Veritas\NetBackup\bin\bpcd.exe -standalone
10:26:31.270 [1328.1668] <2> process_requests: offset to GMT 28800
10:26:31.285 [1328.1668] <2> logconnections: BPCD ACCEPT FROM 10.8.32.42.65377 TO 10.24.32.39.1556 fd = 484
10:26:31.285 [1328.1668] <2> process_requests: setup_sockopts complete
10:26:31.285 [1328.1668] <2> bpcd peer_hostname: Connection from host nbflmaster (10.8.32.42) port 65377
10:26:31.285 [1328.1668] <2> bpcd valid_server: comparing nbflmaster and nbflmaster
10:26:31.285 [1328.1668] <4> bpcd valid_server: hostname comparison succeeded
10:26:31.457 [1328.1668] <2> process_requests: output socket port number = 1
10:26:31.941 [1328.1668] <8> vnet_cached_getaddrinfo_and_update: [vnet_addrinfo.c:1585] in failed file cache ERR=10109 NAME=NULL SVC=testdaemon
10:26:31.941 [1328.1668] <8> vnet_cached_get_service_port: [vnet_addrinfo.c:2396] vnet_cached_getaddrinfo failed STAT=6 RV=10109 NAME=testdaemon
10:26:31.941 [1328.1668] <8> is_pbxable_service: [vnet_connect.c:2159] vnet_cached_get_service_port() failed 6 0x6
10:26:31.941 [1328.1668] <8> is_pbxable_service: [vnet_connect.c:2160] service 53893
10:26:31.941 [1328.1668] <8> file_to_cache_item: [vnet_addrinfo.c:6574] fopen() failed ERRNO=2 FILE=C:\Program Files\Veritas\NetBackup\var\host_cache\14f\6cf9fd4f+53893,1,400,2,1,0+127.0.0.1.txt
10:26:31.941 [1328.1668] <8> verify_hashes: [vnet_vnetd.c:1641] hash_str a162380eb7bc6dab9ebf864b75d0d3f7
10:26:31.941 [1328.1668] <2> process_requests: Duplicated vnetd socket on stderr
10:26:31.941 [1328.1668] <2> process_requests: <---- NetBackup 7.5 0 ------------initiated
10:26:31.941 [1328.1668] <2> process_requests: VERBOSE = 0
10:26:31.941 [1328.1668] <2> process_requests: Not using VxSS authentication with nbflmaster
10:26:32.159 [1328.1668] <2> process_requests: BPCD_GET_VERSION_RQST
10:26:32.362 [1328.1668] <2> process_requests: BPCD_READ_HOST_CONFIG_RQST
10:26:32.814 [1328.1668] <2> process_requests: BPCD_DISCONNECT_RQST
10:26:32.814 [1328.1668] <2> bpcd exit_bpcd: exit status 0  ----------->exiting
10:32:30.242 [3436.1096] <2> vnet_pbxAcceptSocket: Accepted sock[440] from 10.8.32.42:65511
10:32:30.242 [3436.1096] <2> bpcd main: accept sock = 440
10:32:30.273 [3616.1388] <2> setup_debug_log: switched debug log file for bpcd
10:32:30.273 [3616.1388] <2> bpcd main: VERBOSE = 0
10:32:30.273 [3616.1388] <2> logparams: C:\Program Files\Veritas\NetBackup\bin\bpcd.exe -standalone
10:32:30.273 [3616.1388] <2> process_requests: offset to GMT 28800
10:32:30.289 [3616.1388] <2> logconnections: BPCD ACCEPT FROM 10.8.32.42.65511 TO 10.24.32.39.1556 fd = 440
10:32:30.289 [3616.1388] <2> process_requests: setup_sockopts complete
10:32:30.289 [3616.1388] <2> bpcd peer_hostname: Connection from host nbflmaster (10.8.32.42) port 65511
10:32:30.289 [3616.1388] <2> bpcd valid_server: comparing nbflmaster and nbflmaster
10:32:30.289 [3616.1388] <4> bpcd valid_server: hostname comparison succeeded
10:32:30.460 [3616.1388] <2> process_requests: output socket port number = 1
10:32:30.928 [3616.1388] <8> vnet_cached_getaddrinfo_and_update: [vnet_addrinfo.c:1585] in failed file cache ERR=10109 NAME=NULL SVC=testdaemon
10:32:30.928 [3616.1388] <8> vnet_cached_get_service_port: [vnet_addrinfo.c:2396] vnet_cached_getaddrinfo failed STAT=6 RV=10109 NAME=testdaemon
10:32:30.928 [3616.1388] <8> is_pbxable_service: [vnet_connect.c:2159] vnet_cached_get_service_port() failed 6 0x6
10:32:30.928 [3616.1388] <8> is_pbxable_service: [vnet_connect.c:2160] service 53935
10:32:30.928 [3616.1388] <8> file_to_cache_item: [vnet_addrinfo.c:6574] fopen() failed ERRNO=2 FILE=C:\Program Files\Veritas\NetBackup\var\host_cache\14f\6cf9fd4f+53935,1,400,2,1,0+127.0.0.1.txt
10:32:30.928 [3616.1388] <8> verify_hashes: [vnet_vnetd.c:1641] hash_str 6e36faffa8a2544f001d8abad193182c
10:32:30.928 [3616.1388] <2> process_requests: Duplicated vnetd socket on stderr
10:32:30.928 [3616.1388] <2> process_requests: <---- NetBackup 7.5 0 ------------initiated
10:32:30.928 [3616.1388] <2> process_requests: VERBOSE = 0
10:32:30.944 [3616.1388] <2> process_requests: Not using VxSS authentication with nbflmaster
10:32:31.147 [3616.1388] <2> process_requests: BPCD_FORK_CMD_RQST
10:32:31.365 [3616.1388] <2> process_requests: fork cmd = /usr/openv/netbackup/bin/bptm bptm -rptdrv -jobid -1374244313 -jm
10:32:31.365 [3616.1388] <2> process_requests: filter type = -1
10:32:31.365 [3616.1388] <2> process_requests: Convert args to CreateProcess format
10:32:31.365 [3616.1388] <2> process_requests: Done converting args to CreateProcess format
10:32:31.365 [3616.1388] <2> process_requests: new fork cmd = C:\Program Files\Veritas\NetBackup\bin\bptm.exe -rptdrv -jobid -1374244313 -jm
10:32:31.365 [3616.1388] <2> process_requests: Before CreateProcess
10:32:31.365 [3616.1388] <2> process_requests: StdOutput assigned the value STDOUTSOCK
10:32:31.365 [3616.1388] <2> process_requests: final fork cmd = "C:\Program Files\Veritas\NetBackup\bin\bptm.exe" -rptdrv -jobid -1374244313 -jm
10:32:31.365 [3616.1388] <2> process_requests: After CreateProcess, pid = 3496
10:32:31.365 [3616.1388] <2> bpcd exit_bpcd: exit status 0  ----------->exiting
______________________________________________________________________

Log from bpcd restarting services on media server after adding 'verbose' in volmgr -

10:42:30.203 [3436.1096] <2> vnet_pbxAcceptSocket: Accepted sock[472] from 10.8.32.42:49330
10:42:30.203 [3436.1096] <2> bpcd main: accept sock = 472
10:42:30.219 [3268.3412] <2> setup_debug_log: switched debug log file for bpcd
10:42:30.219 [3268.3412] <2> bpcd main: VERBOSE = 0
10:42:30.219 [3268.3412] <2> logparams: C:\Program Files\Veritas\NetBackup\bin\bpcd.exe -standalone
10:42:30.219 [3268.3412] <2> process_requests: offset to GMT 28800
10:42:30.235 [3268.3412] <2> logconnections: BPCD ACCEPT FROM 10.8.32.42.49330 TO 10.24.32.39.1556 fd = 472
10:42:30.235 [3268.3412] <2> process_requests: setup_sockopts complete
10:42:30.235 [3268.3412] <2> bpcd peer_hostname: Connection from host nbflmaster (10.8.32.42) port 49330
10:42:30.235 [3268.3412] <2> bpcd valid_server: comparing nbflmaster and nbflmaster
10:42:30.235 [3268.3412] <4> bpcd valid_server: hostname comparison succeeded
10:42:30.406 [3268.3412] <2> process_requests: output socket port number = 1
10:42:30.890 [3268.3412] <8> vnet_cached_getaddrinfo_and_update: [vnet_addrinfo.c:1585] in failed file cache ERR=10109 NAME=NULL SVC=testdaemon
10:42:30.890 [3268.3412] <8> vnet_cached_get_service_port: [vnet_addrinfo.c:2396] vnet_cached_getaddrinfo failed STAT=6 RV=10109 NAME=testdaemon
10:42:30.890 [3268.3412] <8> is_pbxable_service: [vnet_connect.c:2159] vnet_cached_get_service_port() failed 6 0x6
10:42:30.890 [3268.3412] <8> is_pbxable_service: [vnet_connect.c:2160] service 53973
10:42:30.890 [3268.3412] <8> file_to_cache_item: [vnet_addrinfo.c:6574] fopen() failed ERRNO=2 FILE=C:\Program Files\Veritas\NetBackup\var\host_cache\14f\6cf9fd4f+53973,1,400,2,1,0+127.0.0.1.txt
10:42:30.890 [3268.3412] <8> verify_hashes: [vnet_vnetd.c:1641] hash_str 59e434cdee7b367dcbc56e880249f6fa
10:42:30.905 [3268.3412] <2> process_requests: Duplicated vnetd socket on stderr
10:42:30.905 [3268.3412] <2> process_requests: <---- NetBackup 7.5 0 ------------initiated
10:42:30.905 [3268.3412] <2> process_requests: VERBOSE = 0
10:42:30.905 [3268.3412] <2> process_requests: Not using VxSS authentication with nbflmaster
10:42:31.124 [3268.3412] <2> process_requests: BPCD_FORK_CMD_RQST
10:42:31.342 [3268.3412] <2> process_requests: fork cmd = /usr/openv/netbackup/bin/bptm bptm -rptdrv -jobid -1374244325 -jm
10:42:31.342 [3268.3412] <2> process_requests: filter type = -1
10:42:31.342 [3268.3412] <2> process_requests: Convert args to CreateProcess format
10:42:31.342 [3268.3412] <2> process_requests: Done converting args to CreateProcess format
10:42:31.342 [3268.3412] <2> process_requests: new fork cmd = C:\Program Files\Veritas\NetBackup\bin\bptm.exe -rptdrv -jobid -1374244325 -jm
10:42:31.342 [3268.3412] <2> process_requests: Before CreateProcess
10:42:31.342 [3268.3412] <2> process_requests: StdOutput assigned the value STDOUTSOCK
10:42:31.342 [3268.3412] <2> process_requests: final fork cmd = "C:\Program Files\Veritas\NetBackup\bin\bptm.exe" -rptdrv -jobid -1374244325 -jm
10:42:31.342 [3268.3412] <2> process_requests: After CreateProcess, pid = 2376
10:42:31.342 [3268.3412] <2> bpcd exit_bpcd: exit status 0  ----------->exiting
10:44:01.464 [3436.1096] <2> bpcd main: got terminate request
10:44:01.464 [3436.1096] <4> bpcd main: EXIT status = 0
10:44:17.968 [3468.1588] <2> setup_debug_log: switched debug log file for bpcd
10:44:17.968 [3468.1588] <2> bpcd main: VERBOSE = 0
10:44:17.968 [3468.1588] <2> logparams: C:\Program Files\Veritas\NetBackup\bin\bpcd.exe -standalone
10:44:17.968 [3468.1588] <2> CrankUpNTPrivs: About to EnablePrivilege(SeBackupPrivilege)
10:44:17.968 [3468.1588] <2> CrankUpNTPrivs: About to EnablePrivilege(SeDebugPrivilege)
10:44:17.968 [3468.1588] <2> CrankUpNTPrivs: About to EnablePrivilege(SeRestorePrivilege)
10:44:17.968 [3468.1588] <2> CrankUpNTPrivs: About to EnablePrivilege(SeSecurityPrivilege)
10:44:17.968 [3468.1588] <2> CrankUpNTPrivs: About to EnablePrivilege(SeTakeOwnershipPrivilege)
10:44:17.968 [3468.1588] <2> CrankUpNTPrivs: About to EnablePrivilege(SeTcbPrivilege)
10:44:17.968 [3468.1588] <2> setup_debug_log: switching debug log file for bpcd
10:44:17.968 [3468.1588] <2> setup_debug_log: switched debug log file for bpcd
10:44:17.984 [3468.1588] <2> daemon_startup_listeners: 4 listening for legacy service bpcd
10:44:17.984 [3468.1588] <2> daemon_startup_listeners: listening for vnetd service bpcd
10:44:17.984 [3468.1588] <2> vnet_registerPBXServer: ../../libvlibs/vnet_pbx.c.132: pbxRegisterEx successful at 10.24.32.39:5126/bpcd, returns with 1 alt_addrs
10:44:17.984 [3468.1588] <2> vnet_registerPBXServer: ../../libvlibs/vnet_pbx.c.144: alt_addr: 0.0.0.0:1556

________________________________________________

I compared the installed license keys to existing, working media servers in my environment, and everything matches (actually have an additional license key on this non-working media server).

Nothing pops out in Event Viewer System / Application log. Frustrating. Outside of a license key, is this something that would be causing this service to not start? Should I open up a ticket on this?

[Marianne]

The above bpcd log shows no errors. Does this mean that GUI connection from the master is now successful?

You are not saying if you have Library Based Tape drive license installed on the media server?

Have you added VERBOSE entry in vm.conf and stop/start NBU again on the media server?
The verbose entry should log attempt to start the services in Event Viewer Application log.

Other than license issue, the only other time I have seen services not starting, was when a customer attempted media server installaion on W2008 32-bit OS installation.

[lovethatcheese]

I still get a socket error in the GUI....This media server will have an attached tape drive (attached via SAS cable), and is connected via iscsi initiator to my equal logic san (the drive letter is the same, I can see it at the OS level, can explore thru windows explorer..)

I just rechecked the OS, and it's 64 bit. I have not restarted since adding 'verbose' to vm.conf - I will do this now. I appreciate your continued support / assistance Marianne!

-Scott

[lovethatcheese]

I have restarted the media server OS after adding 'verbose' to vm.conf, completely turned Kaspersky off, and am still getting the socket error..

The master GUI reports under devices -> media servers as this media server being 7.5 - no mention of 7.5.0.6. Is this .6 patch my issue? Should I blow this away and reinstall everything with the .4 patch?

Or will this not accurately update until I clear whatever is causing the socket error?

Seems those are my two issues - this, and Volume manager not starting. Verified license keys are the same on working media servers, the OS can see my attached drives, volmgr sees my tape drives fine...can run bptestbpcd fine - I'm completely stumped.

-Scott