Forum Discussion

o1crimson1o's avatar
7 years ago

Error code 227

(40, 'EXIT STATUS 40: network connection broken\n')

 

The commands used are:

fGetFromTape -C nbtools.vfx.mtl.framestore.com -j j1068 -R /nfs/mtldirvish1/srv/dirvish/dataops/restore/triboroj1068 ./show_restore

which runs:

2018-03-20 19:09:53,152 INFO executing command /usr/openv/netbackup/bin/bprestore -B -K -C nbtools.vfx.mtl.framestore.com -p j1068_archive -w 0 -R /tmp/rewrite_file_16318.txt -k 'fPutToTape|j1068|*|*' -f './show_restore'

All the hosts can see/ping each other. I'm really confused. Below are all the error logs.

 ==> ./bpdbm/root.032018_00001.log <==
18:41:34.227 [25413] <2> DbmOdbcConnect::set_connection_id: -1 -> 3070
18:41:34.229 [25413] <4> FileEnumerator: EMM_Config entry LIST_FS_IMAGE_HEADERS = NO - skipping flat files
18:41:34.231 [25413] <8> DbmOdbcConnect::rollbackTransaction: (3070) success - view count 0
18:41:34.231 [25413] <2> db_sendSTATUS: Status:227
18:41:34.233 [25413] <2> process_request: request complete: exit status 227 no entity was found; query type: 73
18:41:34.235 [25414] <2> daemon_proxy_proto: Preparing to do daemon protocol for (172.22.4.237:13721 <- 172.22.4.237:57098)
18:41:34.235 [25414] <2> logconnections: BPDBM ACCEPT FROM 172.22.4.237.57098 TO 172.22.4.237.13721 fd = 12
18:41:34.236 [25414] <4> bpdbm: VERBOSE = 3
18:41:34.237 [25414] <2> db_logimagerec: protocol version 14 qtype 73 vers 0 client nbtools.vfx.mtl.framestore.com policy j1068_archive
18:41:34.237 [25414] <2> db_logimagerec: date2 03/20/18 18:41:34 (1521585694)
18:41:34.237 [25414] <2> db_logimagerec: sched type ? (12)
18:41:34.237 [25414] <2> db_logimagerec: client type 0 ret level -1 elapsed 0 sec
18:41:34.237 [25414] <2> db_logimagerec: keyword fPutToTape|j1068|*|*
18:41:34.237 [25414] <2> db_logimagerec: backup copy: Standard (0)
18:41:34.237 [25414] <2> db_logimagerec: dump host: ?
18:41:34.237 [25414] <2> image_db: Q_IMAGE_LAST
18:41:34.243 [25414] <2> read_legacy_touch_file: Found /usr/openv/db/data/vxdbms.conf; requested from (../vxdbms_conf.cpp.1509).
18:41:34.252 [25414] <2> DbmOdbcConnect::set_connection_id: -1 -> 3071
18:41:34.254 [25414] <4> FileEnumerator: EMM_Config entry LIST_FS_IMAGE_HEADERS = NO - skipping flat files
18:41:34.255 [25414] <8> DbmOdbcConnect::rollbackTransaction: (3071) success - view count 0
18:41:34.255 [25414] <2> db_sendSTATUS: Status:227
18:41:34.257 [25414] <2> process_request: request complete: exit status 227 no entity was found; query type: 73

==> ./bprd/root.032018_00001.log <==
18:41:34.233 [25410.25410] <2> db_getIMAGE: db_IMAGEreceive: no entity was found 227
18:41:34.233 [25410.25410] <8> vnet_get_user_credential_path: [vnet_vxss.c:1621] status 35 0x23
18:41:34.233 [25410.25410] <8> vnet_check_user_certificate: [vnet_vxss_helper.c:4096] vnet_get_user_credential_path failed 35 0x23
18:41:34.233 [25410.25410] <2> ConnectionCache::connectAndCache: Acquiring new connection for host nbu1.mtl.vfx.framestore.com, query type 73
18:41:34.234 [25410.25410] <2> logconnections: BPDBM CONNECT FROM 172.22.4.237.57098 TO 172.22.4.237.13721 fd = 9
18:41:34.257 [25410.25410] <2> db_getIMAGE: db_IMAGEreceive: no entity was found 227
18:41:34.257 [25410.25410] <2> restorefiles: No backups were found
18:41:34.258 [25410.25410] <2> set_exit_status: entered; status = 227
18:41:34.258 [25410.25410] <2> set_exit_status: client_type = 0
18:41:34.258 [25410.25410] <2> mail_msg_and_set_exit_status: Attempting to send mail to fdenni on nbtools.mtl.vfx.framestore.com
18:41:34.259 [25410.25410] <2> vnet_pbxConnect_ex: pbxConnectExEx Succeeded
18:41:34.306 [25410.25410] <2> logconnections: PROXY CONNECT FROM 172.22.4.237.45602 TO 172.22.4.239.1556 fd = 9
18:41:34.306 [25410.25410] <2> logconnections: BPCD CONNECT FROM 127.0.0.1.56064 TO 127.0.0.1.52694 fd = 9
18:41:34.306 [25410.25410] <2> vnet_connect_to_vnetd_bpcd: js_bpcd_info: 0x15d6610
18:41:34.307 [25410.25410] <2> vnet_pbxConnect_ex: pbxConnectExEx Succeeded
18:41:34.391 [25410.25410] <2> vnet_set_domain_ctx: request VN_REQUEST_SET_DOMAIN_CTX 21
18:41:34.396 [25410.25410] <8> do_pbx_service: [vnet_connect.c:2579] via PBX VNETD CONNECT FROM 172.22.4.237.49352 TO 172.22.4.239.1556 fd = 10
18:41:34.397 [25410.25410] <8> vnet_vnetd_connect_forward_socket_begin: [vnet_vnetd.c:458] VN_REQUEST_CONNECT_FORWARD_SOCKET 10 0xa
18:41:34.398 [25410.25410] <8> vnet_vnetd_connect_forward_socket_begin: [vnet_vnetd.c:483] ipc_string /usr/openv/var/tmp/vnet-13962521585694397706000000055-r3ruOi
18:41:34.479 [25410.25410] <2> bpcr_get_version_rqst: bpcd version: 08100000
18:41:34.479 [25410.25410] <2> mail_msg_and_set_exit_status: CLIENT_CMD_SOCK from bpcr = 9
18:41:34.479 [25410.25410] <2> mail_msg_and_set_exit_status: CLIENT_STAT_SOCK from bpcr = 10
18:41:34.524 [25410.25410] <2> bpcr_get_version_rqst: bpcd version: 08100000
18:41:34.525 [25410.25410] <2> bpcr_get_version_rqst: bpcd version: 08100000
18:41:34.591 [25410.25410] <2> bpcr_get_version_rqst: bpcd version: 08100000
18:41:34.692 [25410.25410] <2> mail_msg_and_set_exit_status: RESTORE EXIT STATUS = 227
18:41:34.692 [25410.25410] <4> JobdSockList::UnregisterSocket: Unregister socket (6).
18:41:36.205 [25410.25410] <2> job_monitoring_exex: ACK disconnect
18:41:36.205 [25410.25410] <2> job_disconnect: Disconnected
18:41:36.205 [25410.25410] <2> terminate_restore: Exit status of restore job is 227 and status message is no entity was found
18:41:36.205 [25410.25410] <4> db_error_add_to_file: Exit status of restore job is 227 and status message is no entity was found
18:41:36.206 [25410.25410] <2> bprd: /usr/openv/netbackup/bin/userreq_notify restore nbtools.mtl.vfx.framestore.com fdenni
18:41:36.225 [3722.3722] <2> listen_loop: do_schild = 1
18:41:36.225 [3722.3722] <2> childterm: pid=25410 exit=227, signo=0 core=no
18:41:36.225 [3722.3722] <2> schild: wait2() ECHILD
^C
[root@nbu1 logs]#

 

 

  • Is it a restore from a "standard" backup or an "archive" backup? I saw the word archive listed on your command line and that makes a difference to which switch you use for the bprestore. Standard backup is what you show on the command line with the -B switch...if it's an archive backup, then you need to change that to -A

    • o1crimson1o's avatar
      o1crimson1o
      Level 4

      From what I can tell it's a standard backup. "User initiated backup" I've checked my polices/storage polices and no where does it say archive.

       

      I'm just using the word archive as it's us "archiving data"

      • o1crimson1o's avatar
        o1crimson1o
        Level 4

        Rerunning the restore command to check logs, I see no mention of a find_files as you suggested.

        show_restore is just:

        103 /fuzzy/job/work/kacheson/houdini/hip/backup/tm057_1000_body_parts_v003_bak9.hip
        182 /fuzzy/job/vault/vfx_image_sequence/film/pv096/pv096_0500/renderws_lighting/cryptoMattePass_L000_main01_A_utility_default_full_mtl.asset.2213931/v003/main_mainId01.1020.exr

        Pages and pages of files to be restored. All like the above example.

  • The error has nothing to do with comms.
    Status 227 means that no backups can be found for the criteria that you have specified.

    The snippet of bprd log is insufficient to troubleshoot. There should be lines containing this:
    <2> find_files:

    What is in './show_restore' ?
    Can you use bplist to firstly list backups for contents of './show_restore' before attempting the restore?