cancel
Showing results for 
Search instead for 
Did you mean: 

Error Code:37 - operation requested by an invalid server

liverpool2507
Level 4

Hello All,

I am trying to run a NFS share backup but it fails with Error code 37: Operation requested by an invalid server.

In the storage unit created, i select media server as my Linux host and when i click on browse button, i can browse the destination in the Linux server (which is the mount point of the filesystem/share created). View properties in the stoarge unit shows proper connectivity.

In the policy, i select, policy type as Standard and On the RHS, i select Foolow NFS. In the Client Selection i select the LInux server(media server) and for backup selection, i browse and select the local data from the same Linux server.

 

Troubleshooting steps tried:

1. Checked if the media server info is available in the EMM database

….\Veritas\NetBackup\bin\admincmd\nbemmcmd -listhost –verbose

Media server name was available there.

2. In the host properties of the master server,  the media server name is added in Media Servers box.

3. Restarted NBU services.

4. Checked /etc/hosts files and /etc/resolv.conf files and the entries are available and proper over there.

5. Tried to clear up the corrupt lock files (if any) by using the folloing steps:

  •  Stopped  all NetBackup daemons/services on the master server
  •  While all NetBackup daemons/services on the master server are stopped, rename the bprd.ddirectory to bprd.d_old
  •  Recreate a new, empty bprd.d directory on the master server
  •  Start the master server NetBackup daemons/services

All the above steps tried did not give any good results and the backup still fails with the same error code.

NBU MAster: Windows 2008 

NBU Version: 7.6.0.1

Media Server: Linux 

 

Any leads will be appreciated.

Thanks in advance!!

Cheers!!!!

 

 

29 REPLIES 29

revarooo
Level 6
Employee

If you have the bprd log enabled, could you post it up?

there is likely a SERVER entry missing that needs to be setup on the master. Probably for the Remote Admin console or a media server

Marianne
Moderator
Moderator
Partner    VIP    Accredited Certified

Check forward and reverse name lookup.

NBU master needs to resolve media server's IP adress to hostname that appears in Master's Server list.

media1 != Media1 != media1.fqdn

One more thing - does the media server have a SERVER entry for itself?
bp.conf should look something like this:

SERVER = master
SERVER = media1
CLIENT_NAME = media1

Please show us all text in Details tab of failed job - this will tell us if the error is coming from the master server or the media server/client.

 

PS :
The bprd folder under netbackup/logs on the master should be 'bprd'. Not bprd.d. 

liverpool2507
Level 4

Hello marriane,

Q: Check forward and reverse name lookup.

A: Forward and reverse nslookup can be resolved.

Q: NBU master needs to resolve media server's IP adress to hostname that appears in Master's Server list.

A: Yes

Q: does the media server have a SERVER entry for itself?

A: yes, it has.

Q.bp.conf  entries:

A: entries in bp.conf look like: 

SERVER = master
SERVER = media1
CLIENT_NAME = media1

Q: text in Details tab of failed job

4/2/2015 12:29:10 AM - Info nbjm(pid=5228) starting backup job (jobid=3121) for client d2dww4.usa.hp.com, policy SAT_halo_nfs, schedule Full  
4/2/2015 12:29:10 AM - Info nbjm(pid=5228) requesting STANDARD_RESOURCE resources from RB for backup job (jobid=3121, request id:{47374F10-93B3-4E99-A30B-60B2FFFCA064})  
4/2/2015 12:29:10 AM - requesting resource SAT_halo
4/2/2015 12:29:10 AM - requesting resource ssdcl498.NBU_CLIENT.MAXJOBS.d2dww4.usa.hp.com
4/2/2015 12:29:10 AM - requesting resource ssdcl498.NBU_POLICY.MAXJOBS.SAT_halo_nfs
4/2/2015 12:29:10 AM - granted resource ssdcl498.NBU_CLIENT.MAXJOBS.d2dww4.usa.hp.com
4/2/2015 12:29:10 AM - granted resource ssdcl498.NBU_POLICY.MAXJOBS.SAT_halo_nfs
4/2/2015 12:29:10 AM - granted resource MediaID=@aaaat;Path=/halo;MediaServer=d2dww4.usa.hp.com
4/2/2015 12:29:10 AM - granted resource SAT_halo
4/2/2015 12:29:10 AM - estimated 0 Kbytes needed
4/2/2015 12:29:10 AM - Info nbjm(pid=5228) started backup (backupid=d2dww4.usa.hp.com_1427956150) job for client d2dww4.usa.hp.com, policy SAT_halo_nfs, schedule Full on storage unit SAT_halo
4/2/2015 12:29:20 AM - started process bpbrm (13608)
4/2/2015 12:29:34 AM - end writing
operation requested by an invalid server(37)

liverpool2507
Level 4

Hi have posted the reply to ur comment twice, but it doesnt seem to be getting published on the website :(

liverpool2507
Level 4

Hello Marianne,

Posting it again...

Check forward and reverse name lookup.

Both can be resolved.

NBU master needs to resolve media server's IP adress to hostname that appears in Master's Server list.

yes, it does.

One more thing - does the media server have a SERVER entry for itself?

Yes, it the entry for itself.


bp.conf should look something like this:

SERVER = master
SERVER = media1
CLIENT_NAME = media1

Yes, the entry in bp.conf looks like the same.

 

Please show us all text in Details tab of failed job 

4/2/2015 12:29:10 AM - Info nbjm(pid=5228) starting backup job (jobid=3121) for client d2dww4.usa.hp.com, policy SAT_halo_nfs, schedule Full  
4/2/2015 12:29:10 AM - Info nbjm(pid=5228) requesting STANDARD_RESOURCE resources from RB for backup job (jobid=3121, request id:{47374F10-93B3-4E99-A30B-60B2FFFCA064})  
4/2/2015 12:29:10 AM - requesting resource SAT_halo
4/2/2015 12:29:10 AM - requesting resource ssdcl498.NBU_CLIENT.MAXJOBS.d2dww4.usa.hp.com
4/2/2015 12:29:10 AM - requesting resource ssdcl498.NBU_POLICY.MAXJOBS.SAT_halo_nfs
4/2/2015 12:29:10 AM - granted resource ssdcl498.NBU_CLIENT.MAXJOBS.d2dww4.usa.hp.com
4/2/2015 12:29:10 AM - granted resource ssdcl498.NBU_POLICY.MAXJOBS.SAT_halo_nfs
4/2/2015 12:29:10 AM - granted resource MediaID=@aaaat;Path=/halo;MediaServer=d2dww4.usa.hp.com
4/2/2015 12:29:10 AM - granted resource SAT_halo
4/2/2015 12:29:10 AM - estimated 0 Kbytes needed
4/2/2015 12:29:10 AM - Info nbjm(pid=5228) started backup (backupid=d2dww4.usa.hp.com_1427956150) job for client d2dww4.usa.hp.com, policy SAT_halo_nfs, schedule Full on storage unit SAT_halo
4/2/2015 12:29:20 AM - started process bpbrm (13608)
4/2/2015 12:29:34 AM - end writing
operation requested by an invalid server(37)

 

 

P.S: Writing the data into a NAS device.

liverpool2507
Level 4
 
Your comment has been queued for moderation by site administrators and will be published after approval.
 
getting the above pop up

Nicolai
Moderator
Moderator
Partner    VIP   

Send a Connect mail to one of the trusted advisors if that happen - I have released your post from moderation.

Nicolai
Moderator
Moderator
Partner    VIP   

Q: Check forward and reverse name lookup.

A: Forward and reverse nslookup can be resolved.

Is the DNS answer authorized ?

liverpool2507
Level 4

Thanks a ton Nicolai...can see my posts now.. :)

Marianne
Moderator
Moderator
Partner    VIP    Accredited Certified

Next step is to create bpbrm and bpcd log folders on the media server, as well as admin log folder on the master.

After next failure, copy logs to .txt files (e.g. bpbrm.txt, bpcd.txt, admin.txt) and upload as File attachments.
 

liverpool2507
Level 4

Hey Nicolai,

Kindly check the below o/p if this is wat im supposed to do..

[root@d2dww4 /]# host <master server IP>
117.5.78.16.in-addr.arpa domain name pointer <master server name>.
[root@d2dww4 /]# dig -x 16.78.5.117

; <<>> DiG 9.3.6-P1-RedHat-9.3.6-20.P1.el5_8.6 <<>> -x <master server IP>
;; global options:  printcmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 53621
;; flags: qr rd ra; QUERY: 1, ANSWER: 1, AUTHORITY: 0, ADDITIONAL: 0

;; QUESTION SECTION:
;117.5.78.16.in-addr.arpa.      IN      PTR

;; ANSWER SECTION:
117.5.78.16.in-addr.arpa. 7108  IN      PTR     <master server name>

;; Query time: 62 msec
;; SERVER: 16.110.135.51#53(16.110.135.51)
;; WHEN: Thu Apr  2 02:26:33 2015
;; MSG SIZE  rcvd: 75

 

 

Have edited the master server name and ip above.

Nicolai
Moderator
Moderator
Partner    VIP   

Netbackup won't accept DNS lookup using pointers (PTR) . It need to be a A record and the DNS servers response need to be authorized. Meaning is has a copy of the zone file.

QUESTION SECTION:
;117.5.78.16.in-addr.arpa.      IN      PTR

;; ANSWER SECTION:
117.5.78.16.in-addr.arpa. 7108  IN      PTR     <master server name>

liverpool2507
Level 4

Below is the log created in admin log folder on master server

05:00:09.880 [22516.22520] <2> bpgetconfig: INITIATING: version NetBackup 7.6 created: 2013111314
05:00:09.880 [22516.22520] <2> logparams: C:\Program Files\Veritas\NetBackup\bin\admincmd\bpgetconfig 
05:00:09.880 [22516.22520] <2> bpgetconfig: VERBOSE = 0
05:01:31.195 [16744.8936] <8> do_pbx_service: [vnet_connect.c:2152] via PBX VNETD CONNECT FROM 16.78.5.117.52681 TO 16.78.7.145.1556 fd = 576
05:01:31.196 [16744.8936] <8> vnet_vnetd_connect_forward_socket_begin: [vnet_vnetd.c:443] VN_REQUEST_CONNECT_FORWARD_SOCKET 10 0xa
05:01:31.236 [16744.8936] <8> vnet_vnetd_connect_forward_socket_begin: [vnet_vnetd.c:460] ipc_string /usr/openv/var/tmp/vnet-29370428058607818838000000026-b2cGDj

 

i created bpbrm and bpcd log folders on the media server (/usr/openv/netbackup/logs)

but nothing gets created there..

 

 

liverpool2507
Level 4

Zone file?? not sure whats that??

revarooo
Level 6
Employee
put the entries for the media server in the local hosts on the master. same with master on the media server. rerun.... what is the result?

Marianne
Moderator
Moderator
Partner    VIP    Accredited Certified
If no logs are created on the media server, then the connection request is not getting there. Either mismatched DNS or hosts entry or else firewall issue. Is OS firewall (iptables) disabled on the media server? Please run 'bpclntcmd -host (media-server ) -verbose -debug' on the master server. Post output and bpcd log on media server ( if created ). Ps. What processes are running on the media server? Check with bpps -x

liverpool2507
Level 4

hey revaroo...

The hosts entries in both media and master server files are correct.

liverpool2507
Level 4

 

is it bpclntcmd or bptestbcd??

Here is the o/p of bptestbpcd on the master server:

C:\Program Files\Veritas\NetBackup\bin\admincmd>bptestbpcd -host d2dww4.usa.hp.com -verbose -debug
06:46:06.875 [21992.15044] <2> bptestbpcd: VERBOSE = 0
06:46:06.882 [21992.15044] <2> vnet_pbxConnect: pbxConnectEx Succeeded
06:46:06.884 [21992.15044] <2> logconnections: BPCD CONNECT FROM 16.78.5.117.56676 TO 16.78.7.145.15
56 fd = 560
06:46:06.896 [21992.15044] <2> vnet_pbxConnect: pbxConnectEx Succeeded
06:46:06.898 [21992.15044] <8> do_pbx_service: [vnet_connect.c:2152] via PBX VNETD CONNECT FROM 16.7
8.5.117.56677 TO 16.78.7.145.1556 fd = 588
06:46:06.899 [21992.15044] <8> vnet_vnetd_connect_forward_socket_begin: [vnet_vnetd.c:443] VN_REQUES
T_CONNECT_FORWARD_SOCKET 10 0xa
06:46:06.939 [21992.15044] <8> vnet_vnetd_connect_forward_socket_begin: [vnet_vnetd.c:460] ipc_strin
g /usr/openv/var/tmp/vnet-30306428064883528901000000026-jJQ6Xv
06:46:07.536 [21992.15044] <2> bpcr_get_version_rqst: bpcd version: 07600000
1 1 1
16.78.5.117:56676 -> 16.78.7.145:1556
16.78.5.117:56677 -> 16.78.7.145:1556
06:46:07.736 [21992.15044] <2> bpcr_get_peername_rqst: Server peername length = 19
06:46:07.936 [21992.15044] <2> bpcr_get_hostname_rqst: Server hostname length = 17
06:46:08.136 [21992.15044] <2> bpcr_get_clientname_rqst: Server clientname length = 17
06:46:08.336 [21992.15044] <2> bpcr_get_version_rqst: bpcd version: 07600000
06:46:08.536 [21992.15044] <2> bpcr_get_platform_rqst: Server platform length = 17
06:46:08.736 [21992.15044] <2> bpcr_get_version_rqst: bpcd version: 07600000
06:46:08.937 [21992.15044] <2> bpcr_patch_version_rqst: theRest == > <
06:46:08.938 [21992.15044] <2> bpcr_get_version_rqst: bpcd version: 07600000
06:46:09.177 [21992.15044] <2> bpcr_patch_version_rqst: theRest == > <
06:46:09.178 [21992.15044] <2> bpcr_get_version_rqst: bpcd version: 07600000
PEER_NAME = ssdcl498.usa.hp.com
HOST_NAME = d2dww4.usa.hp.com
CLIENT_NAME = d2dww4.usa.hp.com
VERSION = 0x07600000
PLATFORM = linuxR_x86_2.6.18
PATCH_VERSION = 7.6.0.1
SERVER_PATCH_VERSION = 7.6.0.1
MASTER_SERVER = ssdcl498.usa.hp.com
EMM_SERVER = ssdcl498.usa.hp.com
NB_MACHINE_TYPE = MEDIA_SERVER
<2>bptestbpcd: EXIT status = 0
06:46:09.386 [21992.15044] <2> bptestbpcd: EXIT status = 0

 

 

O/p of bpps -x command:

[root@d2dww4 bin]# ./bpps -x
NB Processes
------------
root       418     1  0 Apr01 ?        00:00:00 /usr/openv/pdde/pdag/bin/mtstrmd
root       443     1  0 Apr01 ?        00:00:00 /usr/openv/netbackup/bin/bpcompatd
root       457     1  0 Apr01 ?        00:00:02 /usr/openv/netbackup/bin/nbrmms
root       483     1  0 Apr01 ?        00:01:20 /usr/openv/netbackup/bin/nbsl
root       576     1  0 Apr01 ?        00:00:00 /usr/openv/netbackup/bin/nbcssc -a NetBackup
root       591     1  0 Apr01 ?        00:00:01 /usr/openv/netbackup/bin/nbsvcmon
root     30409 32719  0 06:53 ?        00:00:00 /usr/openv/netbackup/bin/bpcd -standalone
root     32716     1  0 Apr01 ?        00:00:00 /usr/openv/netbackup/bin/vnetd -standalone
root     32719     1  0 Apr01 ?        00:00:00 /usr/openv/netbackup/bin/bpcd -standalone
root     32739     1  0 Apr01 ?        00:00:00 /usr/openv/netbackup/bin/nbdisco


MM Processes
------------
root       430     1  0 Apr01 ?        00:00:11 /usr/openv/volmgr/bin/ltid
root       436     1  0 Apr01 ?        00:00:11 vmd


Shared Symantec Processes
-------------------------
root      6885     1  0 Feb12 ?        00:00:05 /opt/VRTSpbx/bin/pbx_exchange

 

Firewall is not running on the media server.

Host entries are proper in both media and master server. (with self entry for the host and for each other)

 

liverpool2507
Level 4

Marriane.. i have replied to ur comment bt cant see it posted..my post has again gone in moderation queue :(