network connection timed out(41)

[Ghustavo]

Master: Windowser Server 2012

Media: Windowser Server 2012

Client: RedHat 2.6.18

NBU: 7.6.0.4

Policy Type: Oracle

Job Schedule: Application-Incr

Schedule Type: Application Backup

17/04/2018 18:01:20 - Info nbjm(pid=1920) starting backup job (jobid=45175) for client srvbd1-rr.rr.trf1.gov.br, policy JFRR-OVm-Bd-04_Bd1Increm, schedule Application-Incr
17/04/2018 18:01:20 - Info nbjm(pid=1920) requesting STANDARD_RESOURCE resources from RB for backup job (jobid=45175, request id:{05783DA9-EDEF-4900-A9E7-D1D26FB62E18})
17/04/2018 18:01:20 - requesting resource dedup.stu.srvbkp1-rr
17/04/2018 18:01:20 - requesting resource srvbkp1-rr.NBU_CLIENT.MAXJOBS.srvbd1-rr.rr.trf1.gov.br
17/04/2018 18:01:20 - requesting resource srvbkp1-rr.NBU_POLICY.MAXJOBS.JFRR-OVm-Bd-04_Bd1Increm
17/04/2018 18:01:20 - awaiting resource dedup.stu.srvbkp1-rr - Maximum job count has been reached for the storage unit
17/04/2018 18:03:20 - Info nbjm(pid=1920) Waiting in NetBackup scheduler work queue on server srvbkp1-rr
17/04/2018 18:05:20 - Info nbjm(pid=1920) Waiting in NetBackup scheduler work queue on server srvbkp1-rr
17/04/2018 18:07:20 - Info nbjm(pid=1920) Waiting in NetBackup scheduler work queue on server srvbkp1-rr
17/04/2018 18:08:02 - granted resource srvbkp1-rr.NBU_CLIENT.MAXJOBS.srvbd1-rr.rr.trf1.gov.br
17/04/2018 18:08:02 - granted resource srvbkp1-rr.NBU_POLICY.MAXJOBS.JFRR-OVm-Bd-04_Bd1Increm
17/04/2018 18:08:02 - granted resource MediaID=@aaaas;DiskVolume=PureDiskVolume;DiskPool=DedupPool;Path=PureDiskVolume;StorageServer=srvbkp1-rr;MediaServer=srvbkp1-rr
17/04/2018 18:08:02 - granted resource dedup.stu.srvbkp1-rr
17/04/2018 18:08:02 - estimated 0 Kbytes needed
17/04/2018 18:08:02 - Info nbjm(pid=1920) started backup (backupid=srvbd1-rr.rr.trf1.gov.br_1524002882) job for client srvbd1-rr.rr.trf1.gov.br, policy JFRR-OVm-Bd-04_Bd1Increm, schedule Application-Incr on storage unit dedup.stu.srvbkp1-rr
17/04/2018 18:08:02 - started process bpbrm (932)
17/04/2018 18:08:03 - Info bpbrm(pid=932) srvbd1-rr.rr.trf1.gov.br is the host to backup data from
17/04/2018 18:08:03 - Info bpbrm(pid=932) reading file list for client
17/04/2018 18:08:03 - connecting
17/04/2018 18:08:05 - Info bpbrm(pid=932) listening for client connection
17/04/2018 18:08:11 - Info bpbrm(pid=932) INF - Client read timeout = 14400
17/04/2018 18:08:11 - Info bpbrm(pid=932) accepted connection from client
17/04/2018 18:08:11 - Info dbclient(pid=661) Backup started
17/04/2018 18:08:11 - Info bptm(pid=8324) start
17/04/2018 18:08:11 - Info bptm(pid=8324) using 1048576 data buffer size
17/04/2018 18:08:11 - Info bptm(pid=8324) setting receive network buffer to 4195328 bytes
17/04/2018 18:08:11 - Info bptm(pid=8324) using 64 data buffers
17/04/2018 18:08:11 - Info bptm(pid=8324) start backup
17/04/2018 18:08:11 - connected; connect time: 0:00:08
17/04/2018 18:08:12 - Info bptm(pid=8324) backup child process is pid 6480.7192
17/04/2018 18:08:12 - Info bptm(pid=6480) start
17/04/2018 18:08:12 - begin writing
17/04/2018 18:30:30 - Info dbclient(pid=661) dbclient(pid=661) wrote first buffer(size=262144)
17/04/2018 22:31:09 - Info srvbkp1-rr(pid=8324) StorageServer=PureDisk:srvbkp1-rr; Report=PDDO Stats for (srvbkp1-rr): scanned: 1027 KB, CR sent: 1020 KB, CR sent over FC: 0 KB, dedup: 0.7%, cache hits: 0 (0.0%)
17/04/2018 22:31:13 - Info dbclient(pid=661) done. status: 41: network connection timed out
17/04/2018 22:31:13 - end writing; write time: 4:23:01
network connection timed out(41)

Log output rman script:

LOG: rman.jfrr.INCR.INCR.201804171900.log

Recovery Manager: Release 12.1.0.2.0 - Production on Tue Apr 17 19:00:15 2018

...

Starting backup at 17-APR-2018 19:00:42

...

RMAN-03009: failure of backup command on ch00 channel at 04/18/2018 02:21:42

ORA-27192: skgfcls: sbtclose2 returned error - failed to close file

ORA-19511: non RMAN, but media manager or vendor specific failure, error text:

   Failed to process backup file <db_6296_1_973710067>

ORA-19502: write error on file "db_6296_1_973710067", block number 385 (block size=8192)

ORA-27030: skgfwrt: sbtwrite2 returned error

ORA-19511: non RMAN, but media manager or vendor specific failure, error text:

   VxBSASendData: Failed with error:

   Server Status

Father job

Schedule: Weekly

Type: Full backup

14/04/2018 00:00:00 - Info nbjm(pid=4836) starting backup job (jobid=44991) for client srvbd1-rr.rr.trf1.gov.br, policy JFRR-OVm-Bd-01_Bd1Full-S, schedule Semanal
14/04/2018 00:00:00 - Info nbjm(pid=4836) requesting MEDIA_SERVER_WITH_ATTRIBUTES resources from RB for backup job (jobid=44991, request id:{58F39CA5-9A83-4225-89CA-F9E2CA245573})
14/04/2018 00:00:00 - requesting resource dedup.stu.srvbkp1-rr
14/04/2018 00:00:00 - requesting resource srvbkp1-rr.NBU_CLIENT.MAXJOBS.srvbd1-rr.rr.trf1.gov.br
14/04/2018 00:00:00 - requesting resource srvbkp1-rr.NBU_POLICY.MAXJOBS.JFRR-OVm-Bd-01_Bd1Full-S
14/04/2018 00:00:00 - granted resource srvbkp1-rr.NBU_CLIENT.MAXJOBS.srvbd1-rr.rr.trf1.gov.br
14/04/2018 00:00:00 - granted resource srvbkp1-rr.NBU_POLICY.MAXJOBS.JFRR-OVm-Bd-01_Bd1Full-S
14/04/2018 00:00:00 - granted resource dedup.stu.srvbkp1-rr
14/04/2018 00:00:03 - estimated 0 Kbytes needed
14/04/2018 00:00:03 - Info nbjm(pid=4836) started backup (backupid=srvbd1-rr.rr.trf1.gov.br_1523678400) job for client srvbd1-rr.rr.trf1.gov.br, policy JFRR-OVm-Bd-01_Bd1Full-S, schedule Semanal on storage unit dedup.stu.srvbkp1-rr
14/04/2018 00:00:05 - started process bpbrm (1548)
14/04/2018 00:00:06 - connecting
14/04/2018 00:00:06 - Info bpbrm(pid=1548) srvbd1-rr.rr.trf1.gov.br is the host to backup data from
14/04/2018 00:00:06 - Info bpbrm(pid=1548) reading file list for client
14/04/2018 00:00:10 - Info bpbrm(pid=1548) starting bphdb on client
14/04/2018 00:00:10 - connected; connect time: 0:00:04
14/04/2018 00:00:20 - Info bphdb(pid=19032) Backup started
14/04/2018 00:00:20 - Info bphdb(pid=19032) Processing /util/backup/bin/rman_full_jfrr.sh
14/04/2018 00:00:20 - Info bphdb(pid=19032) Waiting for the child status
client process aborted(50)

[Marianne]

@Ghustavo

Best to troubleshoot the FULL (Father?) job and ensure this is going through successfully before attempting Incr backup.

Ensure that all of these log folders exist before next backup attempt and set logging level to 3:

Media server: bpbrm and bptm

Client: bphdb and dbclient (change permissions to 777 on these folders)

PS: 
Are you aware that NBU 7.6 reached EOSL more than a year ago?