04-02-2015 12:44 AM
Hello All,
I am trying to run a NFS share backup but it fails with Error code 37: Operation requested by an invalid server.
In the storage unit created, i select media server as my Linux host and when i click on browse button, i can browse the destination in the Linux server (which is the mount point of the filesystem/share created). View properties in the stoarge unit shows proper connectivity.
In the policy, i select, policy type as Standard and On the RHS, i select Foolow NFS. In the Client Selection i select the LInux server(media server) and for backup selection, i browse and select the local data from the same Linux server.
Troubleshooting steps tried:
1. Checked if the media server info is available in the EMM database
….\Veritas\NetBackup\bin\admincmd\nbemmcmd -listhost –verbose
Media server name was available there.
2. In the host properties of the master server, the media server name is added in Media Servers box.
3. Restarted NBU services.
4. Checked /etc/hosts files and /etc/resolv.conf files and the entries are available and proper over there.
5. Tried to clear up the corrupt lock files (if any) by using the folloing steps:
All the above steps tried did not give any good results and the backup still fails with the same error code.
NBU MAster: Windows 2008
NBU Version: 7.6.0.1
Media Server: Linux
Any leads will be appreciated.
Thanks in advance!!
Cheers!!!!
04-02-2015 12:57 AM
If you have the bprd log enabled, could you post it up?
there is likely a SERVER entry missing that needs to be setup on the master. Probably for the Remote Admin console or a media server
04-02-2015 01:15 AM
Check forward and reverse name lookup.
NBU master needs to resolve media server's IP adress to hostname that appears in Master's Server list.
media1 != Media1 != media1.fqdn
One more thing - does the media server have a SERVER entry for itself?
bp.conf should look something like this:
SERVER = master
SERVER = media1
CLIENT_NAME = media1
Please show us all text in Details tab of failed job - this will tell us if the error is coming from the master server or the media server/client.
PS :
The bprd folder under netbackup/logs on the master should be 'bprd'. Not bprd.d.
04-02-2015 01:38 AM
Hello marriane,
Q: Check forward and reverse name lookup.
A: Forward and reverse nslookup can be resolved.
Q: NBU master needs to resolve media server's IP adress to hostname that appears in Master's Server list.
A: Yes
Q: does the media server have a SERVER entry for itself?
A: yes, it has.
Q.bp.conf entries:
A: entries in bp.conf look like:
SERVER = master
SERVER = media1
CLIENT_NAME = media1
Q: text in Details tab of failed job
4/2/2015 12:29:10 AM - Info nbjm(pid=5228) starting backup job (jobid=3121) for client d2dww4.usa.hp.com, policy SAT_halo_nfs, schedule Full
4/2/2015 12:29:10 AM - Info nbjm(pid=5228) requesting STANDARD_RESOURCE resources from RB for backup job (jobid=3121, request id:{47374F10-93B3-4E99-A30B-60B2FFFCA064})
4/2/2015 12:29:10 AM - requesting resource SAT_halo
4/2/2015 12:29:10 AM - requesting resource ssdcl498.NBU_CLIENT.MAXJOBS.d2dww4.usa.hp.com
4/2/2015 12:29:10 AM - requesting resource ssdcl498.NBU_POLICY.MAXJOBS.SAT_halo_nfs
4/2/2015 12:29:10 AM - granted resource ssdcl498.NBU_CLIENT.MAXJOBS.d2dww4.usa.hp.com
4/2/2015 12:29:10 AM - granted resource ssdcl498.NBU_POLICY.MAXJOBS.SAT_halo_nfs
4/2/2015 12:29:10 AM - granted resource MediaID=@aaaat;Path=/halo;MediaServer=d2dww4.usa.hp.com
4/2/2015 12:29:10 AM - granted resource SAT_halo
4/2/2015 12:29:10 AM - estimated 0 Kbytes needed
4/2/2015 12:29:10 AM - Info nbjm(pid=5228) started backup (backupid=d2dww4.usa.hp.com_1427956150) job for client d2dww4.usa.hp.com, policy SAT_halo_nfs, schedule Full on storage unit SAT_halo
4/2/2015 12:29:20 AM - started process bpbrm (13608)
4/2/2015 12:29:34 AM - end writing
operation requested by an invalid server(37)
04-02-2015 01:49 AM
Hi have posted the reply to ur comment twice, but it doesnt seem to be getting published on the website :(
04-02-2015 01:52 AM
Hello Marianne,
Posting it again...
Check forward and reverse name lookup.
Both can be resolved.
NBU master needs to resolve media server's IP adress to hostname that appears in Master's Server list.
yes, it does.
One more thing - does the media server have a SERVER entry for itself?
Yes, it the entry for itself.
bp.conf should look something like this:
SERVER = master
SERVER = media1
CLIENT_NAME = media1
Yes, the entry in bp.conf looks like the same.
Please show us all text in Details tab of failed job
4/2/2015 12:29:10 AM - Info nbjm(pid=5228) starting backup job (jobid=3121) for client d2dww4.usa.hp.com, policy SAT_halo_nfs, schedule Full
4/2/2015 12:29:10 AM - Info nbjm(pid=5228) requesting STANDARD_RESOURCE resources from RB for backup job (jobid=3121, request id:{47374F10-93B3-4E99-A30B-60B2FFFCA064})
4/2/2015 12:29:10 AM - requesting resource SAT_halo
4/2/2015 12:29:10 AM - requesting resource ssdcl498.NBU_CLIENT.MAXJOBS.d2dww4.usa.hp.com
4/2/2015 12:29:10 AM - requesting resource ssdcl498.NBU_POLICY.MAXJOBS.SAT_halo_nfs
4/2/2015 12:29:10 AM - granted resource ssdcl498.NBU_CLIENT.MAXJOBS.d2dww4.usa.hp.com
4/2/2015 12:29:10 AM - granted resource ssdcl498.NBU_POLICY.MAXJOBS.SAT_halo_nfs
4/2/2015 12:29:10 AM - granted resource MediaID=@aaaat;Path=/halo;MediaServer=d2dww4.usa.hp.com
4/2/2015 12:29:10 AM - granted resource SAT_halo
4/2/2015 12:29:10 AM - estimated 0 Kbytes needed
4/2/2015 12:29:10 AM - Info nbjm(pid=5228) started backup (backupid=d2dww4.usa.hp.com_1427956150) job for client d2dww4.usa.hp.com, policy SAT_halo_nfs, schedule Full on storage unit SAT_halo
4/2/2015 12:29:20 AM - started process bpbrm (13608)
4/2/2015 12:29:34 AM - end writing
operation requested by an invalid server(37)
P.S: Writing the data into a NAS device.
04-02-2015 01:53 AM
04-02-2015 01:55 AM
Send a Connect mail to one of the trusted advisors if that happen - I have released your post from moderation.
04-02-2015 01:56 AM
Q: Check forward and reverse name lookup.
A: Forward and reverse nslookup can be resolved.
Is the DNS answer authorized ?
04-02-2015 01:56 AM
Thanks a ton Nicolai...can see my posts now.. :)
04-02-2015 02:01 AM
Next step is to create bpbrm and bpcd log folders on the media server, as well as admin log folder on the master.
After next failure, copy logs to .txt files (e.g. bpbrm.txt, bpcd.txt, admin.txt) and upload as File attachments.
04-02-2015 02:02 AM
Hey Nicolai,
Kindly check the below o/p if this is wat im supposed to do..
[root@d2dww4 /]# host <master server IP>
117.5.78.16.in-addr.arpa domain name pointer <master server name>.
[root@d2dww4 /]# dig -x 16.78.5.117
; <<>> DiG 9.3.6-P1-RedHat-9.3.6-20.P1.el5_8.6 <<>> -x <master server IP>
;; global options: printcmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 53621
;; flags: qr rd ra; QUERY: 1, ANSWER: 1, AUTHORITY: 0, ADDITIONAL: 0
;; QUESTION SECTION:
;117.5.78.16.in-addr.arpa. IN PTR
;; ANSWER SECTION:
117.5.78.16.in-addr.arpa. 7108 IN PTR <master server name>
;; Query time: 62 msec
;; SERVER: 16.110.135.51#53(16.110.135.51)
;; WHEN: Thu Apr 2 02:26:33 2015
;; MSG SIZE rcvd: 75
Have edited the master server name and ip above.
04-03-2015 02:09 AM
Netbackup won't accept DNS lookup using pointers (PTR) . It need to be a A record and the DNS servers response need to be authorized. Meaning is has a copy of the zone file.
QUESTION SECTION:
;117.5.78.16.in-addr.arpa. IN PTR
;; ANSWER SECTION:
117.5.78.16.in-addr.arpa. 7108 IN PTR <master server name>
04-03-2015 04:10 AM
Below is the log created in admin log folder on master server
05:00:09.880 [22516.22520] <2> bpgetconfig: INITIATING: version NetBackup 7.6 created: 2013111314
05:00:09.880 [22516.22520] <2> logparams: C:\Program Files\Veritas\NetBackup\bin\admincmd\bpgetconfig
05:00:09.880 [22516.22520] <2> bpgetconfig: VERBOSE = 0
05:01:31.195 [16744.8936] <8> do_pbx_service: [vnet_connect.c:2152] via PBX VNETD CONNECT FROM 16.78.5.117.52681 TO 16.78.7.145.1556 fd = 576
05:01:31.196 [16744.8936] <8> vnet_vnetd_connect_forward_socket_begin: [vnet_vnetd.c:443] VN_REQUEST_CONNECT_FORWARD_SOCKET 10 0xa
05:01:31.236 [16744.8936] <8> vnet_vnetd_connect_forward_socket_begin: [vnet_vnetd.c:460] ipc_string /usr/openv/var/tmp/vnet-29370428058607818838000000026-b2cGDj
i created bpbrm and bpcd log folders on the media server (/usr/openv/netbackup/logs)
but nothing gets created there..
04-03-2015 04:11 AM
Zone file?? not sure whats that??
04-03-2015 05:12 AM
04-03-2015 05:31 AM
04-03-2015 05:41 AM
hey revaroo...
The hosts entries in both media and master server files are correct.
04-03-2015 06:00 AM
is it bpclntcmd or bptestbcd??
Here is the o/p of bptestbpcd on the master server:
C:\Program Files\Veritas\NetBackup\bin\admincmd>bptestbpcd -host d2dww4.usa.hp.com -verbose -debug
06:46:06.875 [21992.15044] <2> bptestbpcd: VERBOSE = 0
06:46:06.882 [21992.15044] <2> vnet_pbxConnect: pbxConnectEx Succeeded
06:46:06.884 [21992.15044] <2> logconnections: BPCD CONNECT FROM 16.78.5.117.56676 TO 16.78.7.145.15
56 fd = 560
06:46:06.896 [21992.15044] <2> vnet_pbxConnect: pbxConnectEx Succeeded
06:46:06.898 [21992.15044] <8> do_pbx_service: [vnet_connect.c:2152] via PBX VNETD CONNECT FROM 16.7
8.5.117.56677 TO 16.78.7.145.1556 fd = 588
06:46:06.899 [21992.15044] <8> vnet_vnetd_connect_forward_socket_begin: [vnet_vnetd.c:443] VN_REQUES
T_CONNECT_FORWARD_SOCKET 10 0xa
06:46:06.939 [21992.15044] <8> vnet_vnetd_connect_forward_socket_begin: [vnet_vnetd.c:460] ipc_strin
g /usr/openv/var/tmp/vnet-30306428064883528901000000026-jJQ6Xv
06:46:07.536 [21992.15044] <2> bpcr_get_version_rqst: bpcd version: 07600000
1 1 1
16.78.5.117:56676 -> 16.78.7.145:1556
16.78.5.117:56677 -> 16.78.7.145:1556
06:46:07.736 [21992.15044] <2> bpcr_get_peername_rqst: Server peername length = 19
06:46:07.936 [21992.15044] <2> bpcr_get_hostname_rqst: Server hostname length = 17
06:46:08.136 [21992.15044] <2> bpcr_get_clientname_rqst: Server clientname length = 17
06:46:08.336 [21992.15044] <2> bpcr_get_version_rqst: bpcd version: 07600000
06:46:08.536 [21992.15044] <2> bpcr_get_platform_rqst: Server platform length = 17
06:46:08.736 [21992.15044] <2> bpcr_get_version_rqst: bpcd version: 07600000
06:46:08.937 [21992.15044] <2> bpcr_patch_version_rqst: theRest == > <
06:46:08.938 [21992.15044] <2> bpcr_get_version_rqst: bpcd version: 07600000
06:46:09.177 [21992.15044] <2> bpcr_patch_version_rqst: theRest == > <
06:46:09.178 [21992.15044] <2> bpcr_get_version_rqst: bpcd version: 07600000
PEER_NAME = ssdcl498.usa.hp.com
HOST_NAME = d2dww4.usa.hp.com
CLIENT_NAME = d2dww4.usa.hp.com
VERSION = 0x07600000
PLATFORM = linuxR_x86_2.6.18
PATCH_VERSION = 7.6.0.1
SERVER_PATCH_VERSION = 7.6.0.1
MASTER_SERVER = ssdcl498.usa.hp.com
EMM_SERVER = ssdcl498.usa.hp.com
NB_MACHINE_TYPE = MEDIA_SERVER
<2>bptestbpcd: EXIT status = 0
06:46:09.386 [21992.15044] <2> bptestbpcd: EXIT status = 0
O/p of bpps -x command:
[root@d2dww4 bin]# ./bpps -x
NB Processes
------------
root 418 1 0 Apr01 ? 00:00:00 /usr/openv/pdde/pdag/bin/mtstrmd
root 443 1 0 Apr01 ? 00:00:00 /usr/openv/netbackup/bin/bpcompatd
root 457 1 0 Apr01 ? 00:00:02 /usr/openv/netbackup/bin/nbrmms
root 483 1 0 Apr01 ? 00:01:20 /usr/openv/netbackup/bin/nbsl
root 576 1 0 Apr01 ? 00:00:00 /usr/openv/netbackup/bin/nbcssc -a NetBackup
root 591 1 0 Apr01 ? 00:00:01 /usr/openv/netbackup/bin/nbsvcmon
root 30409 32719 0 06:53 ? 00:00:00 /usr/openv/netbackup/bin/bpcd -standalone
root 32716 1 0 Apr01 ? 00:00:00 /usr/openv/netbackup/bin/vnetd -standalone
root 32719 1 0 Apr01 ? 00:00:00 /usr/openv/netbackup/bin/bpcd -standalone
root 32739 1 0 Apr01 ? 00:00:00 /usr/openv/netbackup/bin/nbdisco
MM Processes
------------
root 430 1 0 Apr01 ? 00:00:11 /usr/openv/volmgr/bin/ltid
root 436 1 0 Apr01 ? 00:00:11 vmd
Shared Symantec Processes
-------------------------
root 6885 1 0 Feb12 ? 00:00:05 /opt/VRTSpbx/bin/pbx_exchange
Firewall is not running on the media server.
Host entries are proper in both media and master server. (with self entry for the host and for each other)
04-03-2015 06:08 AM
Marriane.. i have replied to ur comment bt cant see it posted..my post has again gone in moderation queue :(