Solved: oracle database backup error :

Deyaa · ‎04-22-2015

hi ;

currently i configured oracle intelleigent policy for full backup database , and the following error occur :

1: (25) cannot connect on socket

My design as follow :

1- Netbackup /master server "netbackup" : 200.200.200.5

private netwrok for backup "netbackup-bck": 192.168.1.200

2- DB server "dbserver" / media server: 200.200.200.183

private netwrok for backup "dbserver-bck" : 192.168.1.70

bp.conf at master :

root@netbackup # cat /usr/openv/netbackup/bp.conf
SERVER = netbackup
CLIENT_NAME = netbackup-bck
MEDIA_SERVER = netbackup-bck
SERVER = netbackup-bck
SERVER = dbserver-bck
CONNECT_OPTIONS = localhost 0 0 2
USE_VXSS = PROHIBITED
VXSS_SERVICE_TYPE = INTEGRITYANDCONFIDENTIALITY
EMMSERVER = netbackup-bck
HOST_CACHE_TTL = 3600
VXDBMS_NB_DATA = /usr/openv/db/data
OPS_CENTER_SERVER_NAME = netbackup
JOB_PRIORITY = 0 0 90000 90000 90000 90000 85000 85000 80000 80000 80000 80000 75000 75000 70000 70000 50000 50000 45000 0 0 0 0 0
BPDBM_VERBOSE = 2
BPRD_VERBOSE = 2
BPBRM_VERBOSE = 1
BPTM_VERBOSE = 1
BPDM_VERBOSE = 1
BPJOBD_VERBOSE = 1
TELEMETRY_UPLOAD = NO

bp.conf at DB Server :

SERVER = netbackup-bck
SERVER = dbserver-bck
CLIENT_NAME = dbserver-bck
CONNECT_OPTIONS = localhost 1 0 2
USE_VXSS = PROHIBITED
VXSS_SERVICE_TYPE = INTEGRITYANDCONFIDENTIALITY
EMMSERVER = netbackup-bck
HOST_CACHE_TTL = 3600
BPBRM_VERBOSE = 1
BPTM_VERBOSE = 1
BPDM_VERBOSE = 1
TELEMETRY_UPLOAD = YES

job log :

----------

04/22/2015 14:25:15 - Info nbjm (pid=1517) starting backup job (jobid=135) for client netbackup, policy test_DB_policy, schedule Full-disk
04/22/2015 14:25:15 - Info nbjm (pid=1517) requesting MEDIA_SERVER_ONLY resources from RB for backup job (jobid=135, request id:{A1838E92-E8EA-11E4-A092-00144F268829})
04/22/2015 14:25:15 - requesting resource test-standalone
04/22/2015 14:25:15 - requesting resource netbackup.NBU_CLIENT.MAXJOBS.netbackup
04/22/2015 14:25:15 - granted resource netbackup.NBU_CLIENT.MAXJOBS.netbackup
04/22/2015 14:25:16 - estimated 0 kbytes needed
04/22/2015 14:25:16 - begin Parent Job
04/22/2015 14:25:16 - begin Application Resolver: Start Notify Script
04/22/2015 14:25:16 - Info RUNCMD (pid=3321) started
04/22/2015 14:25:16 - Info RUNCMD (pid=3321) exiting with status: 0
Operation Status: 0
04/22/2015 14:25:16 - end Application Resolver: Start Notify Script; elapsed time 0:00:00
04/22/2015 14:25:16 - begin Application Resolver: Step By Condition
Operation Status: 0
04/22/2015 14:25:16 - end Application Resolver: Step By Condition; elapsed time 0:00:00
04/22/2015 14:25:16 - begin Application Resolver: Resolver Discovery
Operation Status: 25

04/22/2015 14:25:16 - end Application Resolver: Resolver Discovery; elapsed time 0:00:00
04/22/2015 14:25:16 - begin Application Resolver: Stop On Error
Operation Status: 0
04/22/2015 14:25:16 - end Application Resolver: Stop On Error; elapsed time 0:00:00
04/22/2015 14:25:16 - begin Application Resolver: End Notify Script
04/22/2015 14:25:16 - Info RUNCMD (pid=3328) started
04/22/2015 14:25:16 - Info RUNCMD (pid=3328) exiting with status: 0
Operation Status: 0
04/22/2015 14:25:16 - end Application Resolver: End Notify Script; elapsed time 0:00:00
Operation Status: 25

04/22/2015 14:25:16 - end Parent Job; elapsed time 0:00:00
cannot connect on socket (25)

bprd log : /usr/openv/netbackup/logs/bprd/log.042215

-----------------------------------------------------------------------------------

14:25:15.710 [1498] <2> bprd: socket fd from accept() is 10
14:25:15.713 [1498] <2> listen_loop: request complete
14:25:15.722 [3313] <2> logconnections: BPRD ACCEPT FROM 200.200.200.5.47634 TO 200.200.200.5.13720 fd = 10
14:25:15.724 [3313] <2> process_request: setsockopt SO_LINGER on 10 succeeded.
14:25:15.726 [3313] <2> connected_peer: Connection from host netbackup, 200.200.200.5, on non-reserved port 47634
14:25:15.728 [3313] <2> process_request: command C_BPBACKUP_7_6 (176) received
14:25:15.728 [3313] <2> process_request: immediate backup request = 329199 176 root root NONE netbackup netbackup-bck NONE test_DB_policy Full-disk 0 NONE 0 4 0 en_US en_US en_US en_US en_US 0 0 -1 0 0 0 0
14:25:15.728 [3313] <2> process_request: After V_sscanf of bufr
14:25:15.728 [3313] <2> process_request: clnt = NONE
14:25:15.728 [3313] <2> process_request: clnthostname = netbackup
14:25:15.728 [3313] <2> process_request: clnt_bp_conf_name = netbackup-bck
14:25:15.728 [3313] <2> process_request: keyword =
14:25:15.728 [3313] <2> process_request: After get_client_and_host_names
14:25:15.728 [3313] <2> process_request: clnt_bp_conf_name = netbackup-bck
14:25:15.728 [3313] <2> process_request: clnt = NONE
14:25:15.728 [3313] <2> process_request: target_hostname = NONE
14:25:15.728 [3313] <2> process_request: retval = 0
14:25:15.728 [3313] <2> process_request: Before bkarfiles
14:25:15.728 [3313] <2> bkarfiles: backup_or_archive = 1
14:25:15.728 [3313] <2> bkarfiles: immediate_or_userdirected = 1
14:25:15.728 [3313] <2> bkarfiles: client = NONE
14:25:15.728 [3313] <2> bkarfiles: client_hostname = NONE
14:25:15.728 [3313] <2> bkarfiles: requesting_user = root
14:25:15.729 [3313] <2> bkarfiles: requesting_group = root
14:25:15.729 [3313] <2> bkarfiles: progress_file = NONE
14:25:15.729 [3313] <2> bkarfiles: policy = test_DB_policy
14:25:15.729 [3313] <2> bkarfiles: sched = Full-disk
14:25:15.729 [3313] <2> bkarfiles: keyword =
14:25:15.729 [3313] <2> bkarfiles: component = NONE
14:25:15.729 [3313] <2> bkarfiles: user_interface = 0
14:25:15.729 [3313] <2> bkarfiles: monitor_backup_job = 0
14:25:15.729 [3313] <2> bkarfiles: backup_jobidstr = NONE
14:25:15.729 [3313] <2> bkarfiles: client_locales_present = 0
14:25:15.729 [3313] <2> bkarfiles: bkup_lc_messages = en_US
14:25:15.729 [3313] <2> bkarfiles: bkup_lc_time = en_US
14:25:15.729 [3313] <2> bkarfiles: bkup_lc_ctype = en_US
14:25:15.729 [3313] <2> bkarfiles: bkup_lc_collate = en_US
14:25:15.729 [3313] <2> bkarfiles: bkup_lc_numeric = en_US
14:25:15.729 [3313] <2> bkarfiles: bkup_with_non_rsvd_ports = 16974338
14:25:15.729 [3313] <2> bkarfiles: client_type = 4
14:25:15.729 [3313] <2> bkarfiles: cverbose = 0
14:25:15.729 [3313] <2> bkarfiles: acknowledge_list = 0
14:25:15.729 [3313] <2> bkarfiles: proxy_copy = 0
14:25:15.729 [3313] <2> bkarfiles: generate_english_logs = 0
14:25:15.729 [3313] <2> bkarfiles: sync_keep_alive = 0
14:25:15.729 [3313] <2> bkarfiles: cbustart = 0
14:25:15.729 [3313] <2> bkarfiles: cbuend = 0
14:25:15.729 [3313] <2> get_next_file_path: received string: /
14:25:15.730 [3313] <2> get_next_file_path: received string: CONTINUE
14:25:16.736 [3313] <4> msgbackup: sent start request to nbpem
14:25:16.736 [3313] <2> bkarfiles: EXIT STATUS = 0
14:25:16.736 [3313] <2> process_request: After bkarfiles(2)
14:25:16.736 [3313] <2> process_request: EXIT STATUS 0
14:25:16.740 [3313] <2> bprd: /usr/openv/netbackup/bin/userreq_notify manual_backup NONE root
14:25:16.823 [1498] <2> listen_loop: do_schild = 1
14:25:16.823 [1498] <2> childterm: pid=3313 exit=0, signo=0 core=no
14:25:16.823 [1498] <2> schild: wait2() ECHILD
14:25:20.388 [1498] <2> bprd: socket fd from accept() is 10
14:25:20.391 [1498] <2> listen_loop: request complete
14:25:20.400 [3352] <2> logconnections: BPRD ACCEPT FROM 200.200.200.5.47640 TO 200.200.200.5.13720 fd = 10
14:25:20.402 [3352] <2> process_request: setsockopt SO_LINGER on 10 succeeded.
14:25:20.404 [3352] <2> connected_peer: Connection from host netbackup, 200.200.200.5, on non-reserved port 47640
14:25:20.406 [3352] <2> process_request: command C_LIKELY_DATE_3_0 (59) received
14:25:20.406 [3352] <2> process_request: likelydate request = 329199 59 netbackup-bck netbackup netbackup-bck NONE 0 12 1414157120 1429709120 en_US en_US en_US en_US en_US 0 0 0 0 0 0 0 0
14:25:20.411 [3352] <2> db_getCLIENT_by_hostname: accessing client /usr/openv/netbackup/db/client/dataguard-bck
14:25:20.412 [3352] <2> db_getCLIENT_by_hostname: hostname netbackup not configured for client dataguard-bck
14:25:20.412 [3352] <2> db_getCLIENT_by_hostname: accessing client /usr/openv/netbackup/db/client/netbackup
14:25:20.412 [3352] <2> db_getCLIENT_by_hostname: hostname netbackup not configured for client netbackup
14:25:20.412 [3352] <2> ConnectionCache::connectAndCache: Acquiring new connection for host netbackup, query type 83
14:25:20.413 [3352] <2> logconnections: BPDBM CONNECT FROM 200.200.200.5.47641 TO 200.200.200.5.13721 fd = 6
14:25:20.533 [3352] <2> db_getIMAGE: db_IMAGEreceive: no entity was found 227
14:25:20.534 [3352] <2> imagelikely: db_getIMAGE() failed: no entity was found
14:25:20.534 [3352] <2> process_request: imagelikely failed - EC status = no entity was found
14:25:20.534 [3352] <2> process_request: EXIT STATUS 227
14:25:20.534 [3352] <2> bprd: /usr/openv/netbackup/bin/userreq_notify image_list netbackup-bck unknown
14:25:20.614 [1498] <2> listen_loop: do_schild = 1
14:25:20.614 [1498] <2> childterm: pid=3352 exit=227, signo=0 core=no
14:25:20.614 [1498] <2> schild: wait2() ECHILD
14:25:21.310 [1498] <2> bprd: socket fd from accept() is 10
14:25:21.312 [1498] <2> listen_loop: request complete
14:25:21.320 [3361] <2> logconnections: BPRD ACCEPT FROM 200.200.200.5.47642 TO 200.200.200.5.13720 fd = 10
14:25:21.322 [3361] <2> process_request: setsockopt SO_LINGER on 10 succeeded.
14:25:21.324 [3361] <2> connected_peer: Connection from host netbackup, 200.200.200.5, on non-reserved port 47642
14:25:21.325 [3361] <2> process_request: command C_IMAGE_LIST_4_5 (81) received
14:25:21.325 [3361] <2> process_request: imagelist request = 329199 81 netbackup-bck netbackup netbackup-bck NONE 0 12 90000 1429826399 en_US en_US en_US en_US en_US 8 0 0 0 512 0 0 0
14:25:21.327 [3361] <2> db_getCLIENT_by_hostname: accessing client /usr/openv/netbackup/db/client/dataguard-bck
14:25:21.328 [3361] <2> db_getCLIENT_by_hostname: hostname netbackup not configured for client dataguard-bck
14:25:21.328 [3361] <2> db_getCLIENT_by_hostname: accessing client /usr/openv/netbackup/db/client/netbackup
14:25:21.328 [3361] <2> db_getCLIENT_by_hostname: hostname netbackup not configured for client netbackup
14:25:21.328 [3361] <2> ConnectionCache::connectAndCache: Acquiring new connection for host netbackup, query type 76
14:25:21.329 [3361] <2> logconnections: BPDBM CONNECT FROM 200.200.200.5.47643 TO 200.200.200.5.13721 fd = 6
14:25:21.437 [3361] <8> imagelist: db_IMAGEreceive failed: no entity was found (227)
14:25:21.437 [3361] <2> process_request: imagelist failed - EC status = no entity was found
14:25:21.438 [3361] <2> process_request: EXIT STATUS 227
14:25:21.438 [3361] <2> bprd: /usr/openv/netbackup/bin/userreq_notify image_list netbackup-bck unknown
14:25:21.519 [1498] <2> listen_loop: do_schild = 1
14:25:21.519 [1498] <2> childterm: pid=3361 exit=227, signo=0 core=no
14:25:21.519 [1498] <2> schild: wait2() ECHILD
14:26:24.527 [1498] <2> get_behavior_rec: ?
14:26:24.527 [1498] <2> get_behavior_rec: MD5 digest line
14:26:24.527 [1498] <2> ConnectionCache::connectAndCache: Acquiring new connection for host netbackup, query type 98
14:26:24.528 [1498] <2> logconnections: BPDBM CONNECT FROM 200.200.200.5.47668 TO 200.200.200.5.13721 fd = 10
14:26:24.528 [1498] <2> db_end: Need to collect reply
14:26:24.658 [1498] <2> launch: /usr/openv/netbackup/bin/admincmd/bpstsinfo, pid=3424
14:26:24.667 [1498] <2> listen_loop: do_schild = 1
14:26:24.667 [1498] <2> childterm: pid=3424 exit=0, signo=0 core=no
14:26:24.667 [1498] <2> schild: wait2() ECHILD
14:31:24.701 [1498] <2> get_behavior_rec: ?
14:31:24.701 [1498] <2> get_behavior_rec: MD5 digest line
14:31:24.701 [1498] <2> ConnectionCache::connectAndCache: Acquiring new connection for host netbackup, query type 98
14:31:24.702 [1498] <2> logconnections: BPDBM CONNECT FROM 200.200.200.5.47682 TO 200.200.200.5.13721 fd = 10
14:31:24.702 [1498] <2> db_end: Need to collect reply
14:31:24.834 [1498] <2> launch: /usr/openv/netbackup/bin/admincmd/bpstsinfo, pid=3631
14:31:24.842 [1498] <2> listen_loop: do_schild = 1
14:31:24.843 [1498] <2> childterm: pid=3631 exit=0, signo=0 core=no
14:31:24.843 [1498] <2> schild: wait2() ECHILD

bpdbm log :/usr/openv/netbackup/logs/bpdbm/log.042215

------------------------------------------------------------------------------------

14:28:30.638 [3508] <2> logconnections: BPDBM ACCEPT FROM 200.200.200.5.47675 TO 200.200.200.5.13721 fd = 10
14:28:30.644 [3508] <4> bpdbm: VERBOSE = 2
14:28:30.647 [3508] <2> db_logimagerec: protocol version 11 qtype 318 vers 0 client ? policy ?
14:28:30.647 [3508] <2> db_logimagerec: date1 04/22/15 14:13:30 (1429704810)
14:28:30.647 [3508] <2> db_logimagerec: date2 04/22/15 14:28:30 (1429705710)
14:28:30.647 [3508] <2> db_logimagerec: sched type ? (9)
14:28:30.647 [3508] <2> db_logimagerec: client type 5 ret level -1 elapsed 0 sec
14:28:30.647 [3508] <2> db_logimagerec: backup copy: Standard (0)
14:28:30.647 [3508] <2> image_db: Q_IMAGE_CATALOG_COLLECTION
14:28:30.667 [3508] <2> read_legacy_touch_file: Found /usr/openv/db/data/vxdbms.conf; requested from (vxdbms_conf.cpp.1528).
14:28:30.718 [3508] <2> DbmOdbcConnect::set_connection_id: -1 -> 2153
14:28:30.887 [3508] <2> process_request: request complete: exit status 227 no entity was found; query type: 318
14:28:30.908 [3509] <2> logconnections: BPDBM ACCEPT FROM 200.200.200.5.47676 TO 200.200.200.5.13721 fd = 10
14:28:30.913 [3509] <4> bpdbm: VERBOSE = 2
14:28:30.915 [3509] <2> db_logimagerec: protocol version 11 qtype 282 vers 0 client ? policy ?
14:28:30.915 [3509] <2> db_logimagerec: date2 04/22/15 14:28:30 (1429705710)
14:28:30.915 [3509] <2> db_logimagerec: sched type ? (9)
14:28:30.915 [3509] <2> db_logimagerec: client type 5 ret level -1 elapsed 0 sec
14:28:30.915 [3509] <2> db_logimagerec: options 0x8 compress 0 encrypt 0 Kbytes 0
14:28:30.915 [3509] <2> db_logimagerec: backup copy: Standard (0)
14:28:30.915 [3509] <2> db_logimagerec: image change log time 1429704810
14:28:30.915 [3509] <2> image_db: Q_IMAGE_CHANGELOG
14:28:30.932 [3509] <2> read_legacy_touch_file: Found /usr/openv/db/data/vxdbms.conf; requested from (vxdbms_conf.cpp.1528).
14:28:30.977 [3509] <2> DbmOdbcConnect::set_connection_id: -1 -> 2154
14:28:31.002 [3509] <2> process_request: request complete: exit status 227 no entity was found; query type: 282
14:30:27.188 [3588] <2> logconnections: BPDBM ACCEPT FROM 200.200.200.5.47679 TO 200.200.200.5.13721 fd = 10
14:30:27.194 [3588] <4> bpdbm: VERBOSE = 2
14:30:27.310 [3588] <2> process_request: request complete: exit status 0 ; query type: 91
14:30:27.332 [3589] <2> logconnections: BPDBM ACCEPT FROM 200.200.200.5.47680 TO 200.200.200.5.13721 fd = 10
14:30:27.338 [3589] <4> bpdbm: VERBOSE = 2
14:30:27.428 [3589] <2> process_request: request complete: exit status 0 ; query type: 91
14:31:24.713 [3630] <2> logconnections: BPDBM ACCEPT FROM 200.200.200.5.47682 TO 200.200.200.5.13721 fd = 10
14:31:24.719 [3630] <4> bpdbm: VERBOSE = 2
14:31:24.739 [3630] <2> process_request: request complete: exit status 0 ; query type: 98

BR

Deyaa

Marianne · ‎04-23-2015

Yes - seems OIP is picking default interface on the master.

No bright spark ideas from my side.... only these suggestions:

Log a call with Symantec regarding OIP and backup network
Use legacy backup scripts until you find solution for point 1.

Handy NetBackup Links

View solution in original post

Nicolai · ‎04-23-2015

Deyaa - could you please try the NBU OIP via the normal network just to confirm it actual work as intended-.

Since actual backup traffic is parsed to a NAS device, do you need the backup network at all ?

View solution in original post

Marianne · ‎04-22-2015

Have you done basic connectivity tests and hostname lookup using -bck names?

What about OS commands such as ping, traceroute and telnet?

Hostname lookup from NBU point of view:

On master:
bpclntcmd -hn dbserver-bck
bpclntcmd -ip 192.168.1.70

On dbserver:
bpclntcmd -hn netbackup-bck
bpclntcmd -ip 192.168.1.200
bpclntcmd -self
bpclntcmd -pn

Connectivity test:

Create bpcd log folder on dbserver under /usr/openv/netbackup/logs

On master:
bptestbpcd -client dbserver-bck -verbose -debug

Check output of command as well as bpcd log on the client.
If nothing in bpcd log, it means that there is something preventing connections (such as company or OS firewall).

When all of the above resolves and connects fine, we can start to have a look at Oracle policy config.
At this stage, it seems that the connection request is not even getting to dbserver. So, nothing to troubleshoot in bprd or bpdbm logs.

Only when the master can connect to dbserver can the Oracle backup process start and dbserver can initiate backup request to bprd on the master.

Handy NetBackup Links

Deyaa · ‎04-22-2015

hi marianne ;

* Have you done basic connectivity tests and hostname lookup using -bck names?

-yes

* What about OS commands such as ping, traceroute and telnet?

-everything go fine

* Hostname lookup from NBU point of view:

On master:

root@netbackup # bpclntcmd -hn dbserver-bck
host dbserver-bck: dbserver-bck at 192.168.1.70
aliases: dbserver-bck 192.168.1.70
root@netbackup # bpclntcmd -ip 192.168.1.70
host 192.168.1.70: dbserver-bck at 192.168.1.70
aliases: dbserver-bck 192.168.1.70

On dbserver:

root@dbserver # bpclntcmd -hn netbackup-bck
host netbackup-bck: netbackup-bck at 192.168.1.200
aliases: netbackup-bck 192.168.1.200

root@dbserver # bpclntcmd -ip 192.168.1.200
host 192.168.1.200: netbackup-bck at 192.168.1.200
aliases: netbackup-bck 192.168.1.200

root@dbserver # bpclntcmd -self
yp_get_default_domain failed: (6) internal yp server or client error
NIS does not seem to be running: (1) args to yp function are bad
gethostname() returned: dbserver-bck
host dbserver-bck: dbserver-bck at 192.168.1.70
aliases: dbserver-bck 192.168.1.70
getfqdn: Error 0

root@dbserver # bpclntcmd -pn
expecting response from server netbackup-bck
dbserver-bck dbserver-bck 192.168.1.70 32840

Connectivity test:

bpcd log: /usr/openv/netbackup/logs/bpcd/log.042215

----------------

15:03:11.212 [25064] <2> vnet_pbxAcceptSocket: Accepted sock[11] from 192.168.1. 200:47869
15:03:11.214 [25064] <2> bpcd main: accept sock = 11
15:03:11.220 [26086] <2> process_requests: offset to GMT -7200
15:03:11.220 [26086] <2> logconnections: BPCD ACCEPT FROM 192.168.1.200.47869 TO 192.168.1.70.1556 fd = 0
15:03:11.221 [26086] <2> process_requests: setup_sockopts complete
15:03:11.222 [26086] <2> bpcd peer_hostname: Connection from host netbackup-bck (192.168.1.200) port 47869
15:03:11.222 [26086] <2> bpcd valid_server: comparing netbackup-bck and netbacku p-bck
15:03:11.222 [26086] <4> bpcd valid_server: hostname comparison succeeded
15:03:11.223 [26086] <2> process_requests: output socket port number = 1
15:03:11.350 [26086] <2> process_requests: Duplicated vnetd socket on stderr
15:03:11.350 [26086] <2> process_requests: <---- NetBackup 7.6.1 0 ------------i nitiated
15:03:11.350 [26086] <2> process_requests: VERBOSE = 0
15:03:11.350 [26086] <2> process_requests: Not using VxSS authentication with ne tbackup-bck
15:03:11.408 [26086] <2> process_requests: BPCD_GET_VERSION_RQST
15:03:11.468 [26086] <2> process_requests: BPCD_WANT_STATUSMSGS_RQST
15:03:11.469 [26086] <2> process_requests: BPCD_FORK_CMD_RQST
15:03:11.469 [26086] <2> process_requests: fork cmd = /usr/openv/netbackup/bin/b ptm bptm -rptdrv -jobid -1429453271 -jm
15:03:11.470 [26086] <2> process_requests: filter type = -1
15:03:11.470 [26086] <2> process_requests: backuptime before fork = 0
15:03:11.471 [26086] <2> bpcd exit_bpcd: exit status 0 ----------->exiting
15:03:11.472 [26088] <2> process_requests: Converting args string into an argv
15:03:11.472 [26088] <2> process_requests: Done converting args string into an a rgv
15:03:11.473 [26088] <2> process_requests: child_args[0] = /usr/openv/netbackup/ bin/bptm
15:03:11.473 [26088] <2> process_requests: child_args[1] = bptm
15:03:11.473 [26088] <2> process_requests: child_args[2] = -rptdrv
15:03:11.473 [26088] <2> process_requests: child_args[3] = -jobid
15:03:11.473 [26088] <2> process_requests: child_args[4] = -1429453271
15:03:11.474 [26088] <2> process_requests: child_args[5] = -jm
15:03:11.474 [26088] <2> process_requests: Before execvp of command
15:03:11.474 [26088] <2> process_requests: Unexpected debugFD == KEYREADFD 4. N

on client :

bptestbpcd -client dbserver-bck -verbose -debug

root@dbserver # bptestbpcd -client dbserver-bck -verbose -debug

15:15:08.011 [26285] <2> bptestbpcd: VERBOSE = 0
15:15:08.012 [26285] <2> ConnectionCache::connectAndCache: Acquiring new connection for host netbackup-bck, query type 223
15:15:08.042 [26285] <2> vnet_pbxConnect: pbxConnectEx Succeeded
15:15:08.043 [26285] <2> logconnections: BPDBM CONNECT FROM 192.168.1.70.15953 TO 192.168.1.200.1556 fd = 4
15:15:08.063 [26285] <2> db_CLIENTsend: reset client protocol version from 0 to 8
15:15:08.166 [26285] <2> db_getCLIENT: db_CLIENTreceive: no entity was found 227
15:15:08.171 [26285] <2> logconnections: BPCD CONNECT FROM 192.168.1.70.16214 TO 192.168.1.70.13782 fd = 4
15:15:08.193 [26285] <2> bpcr_get_version_rqst: bpcd version: 07610001
1 0 2
192.168.1.70:16214 -> 192.168.1.70:13782
192.168.1.70:4233 <- 192.168.1.70:37708
15:15:08.195 [26285] <2> bpcr_get_peername_rqst: Server peername length = 12
15:15:08.196 [26285] <2> bpcr_get_hostname_rqst: Server hostname length = 12
15:15:08.196 [26285] <2> bpcr_get_clientname_rqst: Server clientname length = 12
15:15:08.197 [26285] <2> bpcr_get_version_rqst: bpcd version: 07610001
15:15:08.197 [26285] <2> bpcr_get_platform_rqst: Server platform length = 9
15:15:08.197 [26285] <2> bpcr_get_version_rqst: bpcd version: 07610001
15:15:08.198 [26285] <2> bpcr_patch_version_rqst: theRest == > <
15:15:08.198 [26285] <2> bpcr_get_version_rqst: bpcd version: 07610001
15:15:08.198 [26285] <2> bpcr_patch_version_rqst: theRest == > <
15:15:08.199 [26285] <2> bpcr_get_version_rqst: bpcd version: 07610001
PEER_NAME = dbserver-bck
HOST_NAME = dbserver-bck
CLIENT_NAME = dbserver-bck
VERSION = 0x07610001
PLATFORM = solaris10
PATCH_VERSION = 7.6.1.1
SERVER_PATCH_VERSION = 7.6.1.1
MASTER_SERVER = netbackup-bck
EMM_SERVER = netbackup-bck
NB_MACHINE_TYPE = MEDIA_SERVER
192.168.1.70:3104 <- 192.168.1.70:41951
<2>bptestbpcd: EXIT status = 0
15:15:08.215 [26285] <2> bptestbpcd: EXIT status = 0

On master:
bptestbpcd -client dbserver-bck -verbose -debug

root@netbackup # bptestbpcd -client dbserver-bck -verbose -debug
15:12:33.878 [5724] <2> bptestbpcd: VERBOSE = 0
15:12:33.900 [5724] <2> vnet_pbxConnect: pbxConnectEx Succeeded
15:12:33.901 [5724] <2> logconnections: BPCD CONNECT FROM 192.168.1.200.47894 TO 192.168.1.70.1556 fd = 4
15:12:33.902 [5724] <2> vnet_pbxConnect: pbxConnectEx Succeeded
15:12:33.908 [5724] <8> do_pbx_service: [vnet_connect.c:2156] via PBX VNETD CONN ECT FROM 192.168.1.200.47895 TO 192.168.1.70.1556 fd = 5
15:12:33.908 [5724] <8> vnet_vnetd_connect_forward_socket_begin: [vnet_vnetd.c:4 40] VN_REQUEST_CONNECT_FORWARD_SOCKET 10 0xa
15:12:33.972 [5724] <8> vnet_vnetd_connect_forward_socket_begin: [vnet_vnetd.c:4 57] ipc_string /usr/openv/var/tmp/vnet-26186429708163670902000000000-xPaqjZ
15:12:34.170 [5724] <2> bpcr_get_version_rqst: bpcd version: 07610001
1 1 1
192.168.1.200:47894 -> 192.168.1.70:1556
192.168.1.200:47895 -> 192.168.1.70:1556
15:12:34.240 [5724] <2> bpcr_get_peername_rqst: Server peername length = 13
15:12:34.310 [5724] <2> bpcr_get_hostname_rqst: Server hostname length = 12
15:12:34.380 [5724] <2> bpcr_get_clientname_rqst: Server clientname length = 12
15:12:34.450 [5724] <2> bpcr_get_version_rqst: bpcd version: 07610001
15:12:34.520 [5724] <2> bpcr_get_platform_rqst: Server platform length = 9
15:12:34.590 [5724] <2> bpcr_get_version_rqst: bpcd version: 07610001
15:12:34.660 [5724] <2> bpcr_patch_version_rqst: theRest == > <
15:12:34.660 [5724] <2> bpcr_get_version_rqst: bpcd version: 07610001
15:12:34.720 [5724] <2> bpcr_patch_version_rqst: theRest == > <
15:12:34.720 [5724] <2> bpcr_get_version_rqst: bpcd version: 07610001
PEER_NAME = netbackup-bck
HOST_NAME = dbserver-bck
CLIENT_NAME = dbserver-bck
VERSION = 0x07610001
PLATFORM = solaris10
PATCH_VERSION = 7.6.1.1
SERVER_PATCH_VERSION = 7.6.1.1
MASTER_SERVER = netbackup-bck
EMM_SERVER = netbackup-bck
NB_MACHINE_TYPE = MEDIA_SERVER
15:12:34.792 [5724] <2> vnet_pbxConnect: pbxConnectEx Succeeded
15:12:34.797 [5724] <8> do_pbx_service: [vnet_connect.c:2156] via PBX VNETD CONN ECT FROM 192.168.1.200.47896 TO 192.168.1.70.1556 fd = 6
15:12:34.797 [5724] <8> vnet_vnetd_connect_forward_socket_begin: [vnet_vnetd.c:4 40] VN_REQUEST_CONNECT_FORWARD_SOCKET 10 0xa
15:12:34.862 [5724] <8> vnet_vnetd_connect_forward_socket_begin: [vnet_vnetd.c:4 57] ipc_string /usr/openv/var/tmp/vnet-26187429708164560976000000000-r3ayjZ
192.168.1.200:47896 -> 192.168.1.70:1556
<2>bptestbpcd: EXIT status = 0
15:12:34.930 [5724] <2> bptestbpcd: EXIT status = 0

Deyaa · ‎04-22-2015

* Have you done basic connectivity tests and hostname lookup using -bck names?

-yes

* What about OS commands such as ping, traceroute and telnet?

-everything go fine

* Hostname lookup from NBU point of view:

On master:

root@netbackup # bpclntcmd -hn dbserver-bck
host dbserver-bck: dbserver-bck at 192.168.1.70
aliases: dbserver-bck 192.168.1.70
root@netbackup # bpclntcmd -ip 192.168.1.70
host 192.168.1.70: dbserver-bck at 192.168.1.70
aliases: dbserver-bck 192.168.1.70

On dbserver:

root@dbserver # bpclntcmd -hn netbackup-bck
host netbackup-bck: netbackup-bck at 192.168.1.200
aliases: netbackup-bck 192.168.1.200

root@dbserver # bpclntcmd -ip 192.168.1.200
host 192.168.1.200: netbackup-bck at 192.168.1.200
aliases: netbackup-bck 192.168.1.200

root@dbserver # bpclntcmd -self
yp_get_default_domain failed: (6) internal yp server or client error
NIS does not seem to be running: (1) args to yp function are bad
gethostname() returned: dbserver-bck
host dbserver-bck: dbserver-bck at 192.168.1.70
aliases: dbserver-bck 192.168.1.70
getfqdn: Error 0

root@dbserver # bpclntcmd -pn
expecting response from server netbackup-bck
dbserver-bck dbserver-bck 192.168.1.70 32840

Connectivity test:

bpcd log: /usr/openv/netbackup/logs/bpcd/log.042215

----------------

15:03:11.212 [25064] <2> vnet_pbxAcceptSocket: Accepted sock[11] from 192.168.1. 200:47869
15:03:11.214 [25064] <2> bpcd main: accept sock = 11
15:03:11.220 [26086] <2> process_requests: offset to GMT -7200
15:03:11.220 [26086] <2> logconnections: BPCD ACCEPT FROM 192.168.1.200.47869 TO 192.168.1.70.1556 fd = 0
15:03:11.221 [26086] <2> process_requests: setup_sockopts complete
15:03:11.222 [26086] <2> bpcd peer_hostname: Connection from host netbackup-bck (192.168.1.200) port 47869
15:03:11.222 [26086] <2> bpcd valid_server: comparing netbackup-bck and netbacku p-bck
15:03:11.222 [26086] <4> bpcd valid_server: hostname comparison succeeded
15:03:11.223 [26086] <2> process_requests: output socket port number = 1
15:03:11.350 [26086] <2> process_requests: Duplicated vnetd socket on stderr
15:03:11.350 [26086] <2> process_requests: <---- NetBackup 7.6.1 0 ------------i nitiated
15:03:11.350 [26086] <2> process_requests: VERBOSE = 0
15:03:11.350 [26086] <2> process_requests: Not using VxSS authentication with ne tbackup-bck
15:03:11.408 [26086] <2> process_requests: BPCD_GET_VERSION_RQST
15:03:11.468 [26086] <2> process_requests: BPCD_WANT_STATUSMSGS_RQST
15:03:11.469 [26086] <2> process_requests: BPCD_FORK_CMD_RQST
15:03:11.469 [26086] <2> process_requests: fork cmd = /usr/openv/netbackup/bin/b ptm bptm -rptdrv -jobid -1429453271 -jm
15:03:11.470 [26086] <2> process_requests: filter type = -1
15:03:11.470 [26086] <2> process_requests: backuptime before fork = 0
15:03:11.471 [26086] <2> bpcd exit_bpcd: exit status 0 ----------->exiting
15:03:11.472 [26088] <2> process_requests: Converting args string into an argv
15:03:11.472 [26088] <2> process_requests: Done converting args string into an a rgv
15:03:11.473 [26088] <2> process_requests: child_args[0] = /usr/openv/netbackup/ bin/bptm
15:03:11.473 [26088] <2> process_requests: child_args[1] = bptm
15:03:11.473 [26088] <2> process_requests: child_args[2] = -rptdrv
15:03:11.473 [26088] <2> process_requests: child_args[3] = -jobid
15:03:11.473 [26088] <2> process_requests: child_args[4] = -1429453271
15:03:11.474 [26088] <2> process_requests: child_args[5] = -jm
15:03:11.474 [26088] <2> process_requests: Before execvp of command
15:03:11.474 [26088] <2> process_requests: Unexpected debugFD == KEYREADFD 4. N

on client :

bptestbpcd -client dbserver-bck -verbose -debug

root@dbserver # bptestbpcd -client dbserver-bck -verbose -debug

15:15:08.011 [26285] <2> bptestbpcd: VERBOSE = 0
15:15:08.012 [26285] <2> ConnectionCache::connectAndCache: Acquiring new connection for host netbackup-bck, query type 223
15:15:08.042 [26285] <2> vnet_pbxConnect: pbxConnectEx Succeeded
15:15:08.043 [26285] <2> logconnections: BPDBM CONNECT FROM 192.168.1.70.15953 TO 192.168.1.200.1556 fd = 4
15:15:08.063 [26285] <2> db_CLIENTsend: reset client protocol version from 0 to 8
15:15:08.166 [26285] <2> db_getCLIENT: db_CLIENTreceive: no entity was found 227
15:15:08.171 [26285] <2> logconnections: BPCD CONNECT FROM 192.168.1.70.16214 TO 192.168.1.70.13782 fd = 4
15:15:08.193 [26285] <2> bpcr_get_version_rqst: bpcd version: 07610001
1 0 2
192.168.1.70:16214 -> 192.168.1.70:13782
192.168.1.70:4233 <- 192.168.1.70:37708
15:15:08.195 [26285] <2> bpcr_get_peername_rqst: Server peername length = 12
15:15:08.196 [26285] <2> bpcr_get_hostname_rqst: Server hostname length = 12
15:15:08.196 [26285] <2> bpcr_get_clientname_rqst: Server clientname length = 12
15:15:08.197 [26285] <2> bpcr_get_version_rqst: bpcd version: 07610001
15:15:08.197 [26285] <2> bpcr_get_platform_rqst: Server platform length = 9
15:15:08.197 [26285] <2> bpcr_get_version_rqst: bpcd version: 07610001
15:15:08.198 [26285] <2> bpcr_patch_version_rqst: theRest == > <
15:15:08.198 [26285] <2> bpcr_get_version_rqst: bpcd version: 07610001
15:15:08.198 [26285] <2> bpcr_patch_version_rqst: theRest == > <
15:15:08.199 [26285] <2> bpcr_get_version_rqst: bpcd version: 07610001
PEER_NAME = dbserver-bck
HOST_NAME = dbserver-bck
CLIENT_NAME = dbserver-bck
VERSION = 0x07610001
PLATFORM = solaris10
PATCH_VERSION = 7.6.1.1
SERVER_PATCH_VERSION = 7.6.1.1
MASTER_SERVER = netbackup-bck
EMM_SERVER = netbackup-bck
NB_MACHINE_TYPE = MEDIA_SERVER
192.168.1.70:3104 <- 192.168.1.70:41951
<2>bptestbpcd: EXIT status = 0
15:15:08.215 [26285] <2> bptestbpcd: EXIT status = 0

On master:
bptestbpcd -client dbserver-bck -verbose -debug

root@netbackup # bptestbpcd -client dbserver-bck -verbose -debug
15:12:33.878 [5724] <2> bptestbpcd: VERBOSE = 0
15:12:33.900 [5724] <2> vnet_pbxConnect: pbxConnectEx Succeeded
15:12:33.901 [5724] <2> logconnections: BPCD CONNECT FROM 192.168.1.200.47894 TO 192.168.1.70.1556 fd = 4
15:12:33.902 [5724] <2> vnet_pbxConnect: pbxConnectEx Succeeded
15:12:33.908 [5724] <8> do_pbx_service: [vnet_connect.c:2156] via PBX VNETD CONN ECT FROM 192.168.1.200.47895 TO 192.168.1.70.1556 fd = 5
15:12:33.908 [5724] <8> vnet_vnetd_connect_forward_socket_begin: [vnet_vnetd.c:4 40] VN_REQUEST_CONNECT_FORWARD_SOCKET 10 0xa
15:12:33.972 [5724] <8> vnet_vnetd_connect_forward_socket_begin: [vnet_vnetd.c:4 57] ipc_string /usr/openv/var/tmp/vnet-26186429708163670902000000000-xPaqjZ
15:12:34.170 [5724] <2> bpcr_get_version_rqst: bpcd version: 07610001
1 1 1
192.168.1.200:47894 -> 192.168.1.70:1556
192.168.1.200:47895 -> 192.168.1.70:1556
15:12:34.240 [5724] <2> bpcr_get_peername_rqst: Server peername length = 13
15:12:34.310 [5724] <2> bpcr_get_hostname_rqst: Server hostname length = 12
15:12:34.380 [5724] <2> bpcr_get_clientname_rqst: Server clientname length = 12
15:12:34.450 [5724] <2> bpcr_get_version_rqst: bpcd version: 07610001
15:12:34.520 [5724] <2> bpcr_get_platform_rqst: Server platform length = 9
15:12:34.590 [5724] <2> bpcr_get_version_rqst: bpcd version: 07610001
15:12:34.660 [5724] <2> bpcr_patch_version_rqst: theRest == > <
15:12:34.660 [5724] <2> bpcr_get_version_rqst: bpcd version: 07610001
15:12:34.720 [5724] <2> bpcr_patch_version_rqst: theRest == > <
15:12:34.720 [5724] <2> bpcr_get_version_rqst: bpcd version: 07610001
PEER_NAME = netbackup-bck
HOST_NAME = dbserver-bck
CLIENT_NAME = dbserver-bck
VERSION = 0x07610001
PLATFORM = solaris10
PATCH_VERSION = 7.6.1.1
SERVER_PATCH_VERSION = 7.6.1.1
MASTER_SERVER = netbackup-bck
EMM_SERVER = netbackup-bck
NB_MACHINE_TYPE = MEDIA_SERVER
15:12:34.792 [5724] <2> vnet_pbxConnect: pbxConnectEx Succeeded
15:12:34.797 [5724] <8> do_pbx_service: [vnet_connect.c:2156] via PBX VNETD CONN ECT FROM 192.168.1.200.47896 TO 192.168.1.70.1556 fd = 6
15:12:34.797 [5724] <8> vnet_vnetd_connect_forward_socket_begin: [vnet_vnetd.c:4 40] VN_REQUEST_CONNECT_FORWARD_SOCKET 10 0xa
15:12:34.862 [5724] <8> vnet_vnetd_connect_forward_socket_begin: [vnet_vnetd.c:4 57] ipc_string /usr/openv/var/tmp/vnet-26187429708164560976000000000-r3ayjZ
192.168.1.200:47896 -> 192.168.1.70:1556
<2>bptestbpcd: EXIT status = 0
15:12:34.930 [5724] <2> bptestbpcd: EXIT status = 0

anwin · ‎04-22-2015

Hi Deyaa,

Have you checked the result for a bpcd test

here is the command -

bptestbpcd -client <client_name> -verbose

Please paste the output here.

Thanks and Best Regards,

Anwin

Nicolai · ‎04-22-2015

Please attach debug text as a file to a post.

anwin · ‎04-22-2015

Hey Deyaa,

Think the " bpclntcmd -self" is failing according to your output.

Here is what I found online for this -

https://support.symantec.com/en_US/article.TECH199672.html

Hope this works for you

Thanks and Best Regards,

Anwin

Deyaa · ‎04-22-2015

please check the attachment

Marianne · ‎04-22-2015

Okay, all name lookup and connectivity tests are fine.

Tell us more about the Oracle backup - using Oracle Intelligent Policy or traditional rman scripts?
What does the policy look like?
bppllist <policy-name> -U

Where is backup intitiated from?

Handy NetBackup Links

Deyaa · ‎04-22-2015

hi marianne ;

iam using Oracle Intelligent Policy , and the backup initiated from the master server

regarding to bppllist policy please check the attachement .

BR

Deyaa

Marianne · ‎04-22-2015

We need help here from someone with OIP experience...
(I have never done it).

I will contact some of our experts...

Handy NetBackup Links

Deyaa · ‎04-22-2015

thanks marianne

RamNagalla · ‎04-22-2015

Hello Deyaa,

I assume FS backups are running fine for the client with out any issues...

Does the Oracle Intelligent Policy backups ever succesfull for this DB?

have you provided the credentials for DB authentication and RMAN recovery catalog .?

Deyaa · ‎04-22-2015

Hi Nagalla ;

yes the FS backups are running fine , and DB policy didn't work successfully before.

the credentials for DB authentication , i use OS authentication user : oracle and i don't use RMAN recovery catalog.

BR

Deyaa

Marianne · ‎04-22-2015

Have a look at Manually adding an Oracle instance to the repository on p. 76 of NetBackup for Oracle Administrator's Guide

Add dbserver-bck hostname, Instance, ORACLE_HOME and provide OS Credentials.

Handy NetBackup Links

Nicolai · ‎04-22-2015

Do you get entries in bpdbsbora ?

http://www.mass.dk/netbackup/quick-hints/101-rman-input-a-output-using-intelligent-polices-in-netbackup-76.html

Deyaa · ‎04-22-2015

no , there is no entries.

Deyaa · ‎04-22-2015

the same error

Deyaa · ‎04-23-2015

hi all ;

i find something that may be the cause of the problem ; i design the database server as Enterprise client so it will backup to NAS storage direct without passing through Netbackup via private vlan .

Master server :

netbackup :200.200.200.5

netbackup-bck"private vlan" : 192.168.1.200

DB server :

dbserver: 200.200.200.183

dbserver-bck"private vlan" : 192.168.1.70

when i initiate all FS backup , the Client and Media Server are the same ex: client : newpension1-bck , media server :newpension1-bck [ both are -bck] , but in our case when i initiate database backup the client : netbackup " public master server" and the media server is dbserver-bck

please check the attached snapshot for more details .

is this correct ? please advice

BR

Deyaa

Nicolai · ‎04-23-2015

Could be the problem - but still difficult to say "remote". NBU OIP may pick up the "wrong" host name so to say.

It's a long shot, but try to set/configure prefered interface in Netbackup

Best practices for Preferred Network, usage, and how it affects source and destinatio

http://www.symantec.com/docs/HOWTO60779

One about the same issue.

Required Interface or Preferred Network settings seem to cause connections between non-routed networks on weakhost platforms

http://www.symantec.com/docs/TECH203313

VOX

oracle database backup error :