no images were successfully processed (191)

Question

Good dayKindly assist me with below issue.For some days now all my NetBackup replication jobs keeps failing with status code 191. In NetBackup admin console at activity monitor, when i try to restart job (to retry the replication i don't see option to retry all i see there is grayed out.NetBackup Ver=9.1I will greatly appreciate your support, please find below log message.Feb&nbsp;22,&nbsp;2024&nbsp;3:06:13&nbsp;PM&nbsp;-&nbsp;requesting&nbsp;resource&nbsp;&nbsp;LCM_KS-BKP-MED02.abc.root.netFeb&nbsp;22,&nbsp;2024&nbsp;3:06:13&nbsp;PM&nbsp;-&nbsp;granted&nbsp;resource&nbsp;&nbsp;LCM_KS-BKP-MED02.abc.root.netFeb&nbsp;22,&nbsp;2024&nbsp;3:06:14&nbsp;PM&nbsp;-&nbsp;Info&nbsp;nbreplicate&nbsp;(pid=14456)&nbsp;Suspend&nbsp;window&nbsp;close&nbsp;behavior&nbsp;is&nbsp;not&nbsp;supported&nbsp;for&nbsp;nbreplicateFeb&nbsp;22,&nbsp;2024&nbsp;3:06:14&nbsp;PM&nbsp;-&nbsp;Info&nbsp;nbreplicate&nbsp;(pid=14456)&nbsp;window&nbsp;close&nbsp;behavior:&nbsp;Continue&nbsp;processing&nbsp;the&nbsp;current&nbsp;imageFeb&nbsp;22,&nbsp;2024&nbsp;3:06:14&nbsp;PM&nbsp;-&nbsp;started&nbsp;process&nbsp;RUNCMD&nbsp;(pid=14456)Feb&nbsp;22,&nbsp;2024&nbsp;3:06:14&nbsp;PM&nbsp;-&nbsp;requesting&nbsp;resource&nbsp;&nbsp;@aaaadFeb&nbsp;22,&nbsp;2024&nbsp;3:06:14&nbsp;PM&nbsp;-&nbsp;reserving&nbsp;resource&nbsp;@aaaadFeb&nbsp;22,&nbsp;2024&nbsp;3:06:15&nbsp;PM&nbsp;-&nbsp;resource&nbsp;@aaaad&nbsp;reservedFeb&nbsp;22,&nbsp;2024&nbsp;3:06:15&nbsp;PM&nbsp;-&nbsp;granted&nbsp;resource&nbsp;&nbsp;MediaID=@aaaad;DiskVolume=PureDiskVolume;DiskPool=DP_PD_MED02;Path=PureDiskVolume;StorageServer=ac1-bkp-med02.abc.root.net;MediaServer=ac1-bkp-med03.abc.root.netFeb&nbsp;22,&nbsp;2024&nbsp;3:06:16&nbsp;PM&nbsp;-&nbsp;Info&nbsp;bpdm&nbsp;(pid=1544)&nbsp;startedFeb&nbsp;22,&nbsp;2024&nbsp;3:06:16&nbsp;PM&nbsp;-&nbsp;started&nbsp;process&nbsp;bpdm&nbsp;(pid=1544)Feb&nbsp;22,&nbsp;2024&nbsp;3:06:22&nbsp;PM&nbsp;-&nbsp;Info&nbsp;ac1-bkp-med03.abc.root.net&nbsp;(pid=1544)&nbsp;StorageServer=PureDisk:ac1-bkp-med02.abc.root.net;&nbsp;Report=PDDO&nbsp;Stats&nbsp;for&nbsp;(ac1-bkp-med02.abc.root.net):&nbsp;scanned:&nbsp;4&nbsp;KB,&nbsp;CR&nbsp;sent:&nbsp;0&nbsp;KB,&nbsp;CR&nbsp;sent&nbsp;over&nbsp;FC:&nbsp;0&nbsp;KB,&nbsp;dedup:&nbsp;100.0%,&nbsp;cache&nbsp;disabled,&nbsp;where&nbsp;dedup&nbsp;space&nbsp;saving:75.0%,&nbsp;compression&nbsp;space&nbsp;saving:25.0%Feb&nbsp;22,&nbsp;2024&nbsp;3:06:25&nbsp;PM&nbsp;-&nbsp;Info&nbsp;ac1-bkp-med03.abc.root.net&nbsp;(pid=1544)&nbsp;Using&nbsp;OpenStorage&nbsp;to&nbsp;replicate&nbsp;backup&nbsp;id&nbsp;ghasss1_1708465505,&nbsp;media&nbsp;id&nbsp;@aaaad,&nbsp;storage&nbsp;server&nbsp;ac1-bkp-med02.abc.root.net,&nbsp;disk&nbsp;volume&nbsp;PureDiskVolumeFeb&nbsp;22,&nbsp;2024&nbsp;3:06:26&nbsp;PM&nbsp;-&nbsp;Info&nbsp;ac1-bkp-med03.abc.root.net&nbsp;(pid=1544)&nbsp;Replicating&nbsp;images&nbsp;to&nbsp;target&nbsp;storage&nbsp;server&nbsp;KS-BKP-MED02.abc.root.net,&nbsp;disk&nbsp;volume&nbsp;PureDiskVolumeFeb&nbsp;22,&nbsp;2024&nbsp;3:17:01&nbsp;PM&nbsp;-&nbsp;Critical&nbsp;bpdm&nbsp;(pid=1544)&nbsp;Storage&nbsp;Server&nbsp;Error:&nbsp;(Storage&nbsp;server:&nbsp;PureDisk:ac1-bkp-med02.abc.root.net)&nbsp;async_get_job_status:&nbsp;Replication&nbsp;started&nbsp;but&nbsp;failed&nbsp;to&nbsp;complete&nbsp;successfully:&nbsp;&nbsp;__sosend:&nbsp;_crStreamWrite&nbsp;failed&nbsp;to&nbsp;send&nbsp;crc:&nbsp;connection&nbsp;reset&nbsp;by&nbsp;peer.&nbsp;Look&nbsp;at&nbsp;the&nbsp;replication&nbsp;logs&nbsp;on&nbsp;the&nbsp;source&nbsp;storage&nbsp;server&nbsp;for&nbsp;more&nbsp;information.&nbsp;V-454-105Feb&nbsp;22,&nbsp;2024&nbsp;3:17:01&nbsp;PM&nbsp;-&nbsp;Error&nbsp;bpdm&nbsp;(pid=1544)&nbsp;&lt;async&gt;&nbsp;wait&nbsp;failed:&nbsp;error&nbsp;2060014:&nbsp;operation&nbsp;abortedFeb&nbsp;22,&nbsp;2024&nbsp;3:17:01&nbsp;PM&nbsp;-&nbsp;Error&nbsp;bpdm&nbsp;(pid=1544)&nbsp;wait&nbsp;failed:&nbsp;error&nbsp;150Feb&nbsp;22,&nbsp;2024&nbsp;3:17:01&nbsp;PM&nbsp;-&nbsp;Error&nbsp;bpdm&nbsp;(pid=1544)&nbsp;&lt;async&gt;&nbsp;cancel&nbsp;failed:&nbsp;error&nbsp;2060001:&nbsp;one&nbsp;or&nbsp;more&nbsp;invalid&nbsp;argumentsFeb&nbsp;22,&nbsp;2024&nbsp;3:17:01&nbsp;PM&nbsp;-&nbsp;Error&nbsp;bpdm&nbsp;(pid=1544)&nbsp;copy&nbsp;cancel&nbsp;failed:&nbsp;error&nbsp;174Feb&nbsp;22,&nbsp;2024&nbsp;3:17:02&nbsp;PM&nbsp;-&nbsp;Info&nbsp;ac1-bkp-med03.abc.root.net&nbsp;(pid=1544)&nbsp;StorageServer=PureDisk:ac1-bkp-med02.abc.root.net;&nbsp;Report=PDDO&nbsp;Stats&nbsp;for&nbsp;(ac1-bkp-med02.abc.root.net):&nbsp;scanned:&nbsp;4&nbsp;KB,&nbsp;CR&nbsp;sent:&nbsp;0&nbsp;KB,&nbsp;CR&nbsp;sent&nbsp;over&nbsp;FC:&nbsp;0&nbsp;KB,&nbsp;dedup:&nbsp;100.0%,&nbsp;cache&nbsp;disabled,&nbsp;where&nbsp;dedup&nbsp;space&nbsp;saving:0.0%,&nbsp;compression&nbsp;space&nbsp;saving:100.0%Feb&nbsp;22,&nbsp;2024&nbsp;3:17:02&nbsp;PM&nbsp;-&nbsp;Error&nbsp;nbreplicate&nbsp;(pid=14456)&nbsp;ReplicationJob::Replicate:&nbsp;Replication&nbsp;failed&nbsp;for&nbsp;backup&nbsp;id&nbsp;ghasss1_1708465505:&nbsp;media&nbsp;write&nbsp;error&nbsp;(84)Feb&nbsp;22,&nbsp;2024&nbsp;3:17:02&nbsp;PM&nbsp;-&nbsp;Replicate&nbsp;failed&nbsp;for&nbsp;backup&nbsp;id&nbsp;ghasss1_1708465505&nbsp;with&nbsp;status&nbsp;84no&nbsp;images&nbsp;were&nbsp;successfully&nbsp;processed&nbsp; (191)&nbsp;Thank you

quebek · Answer

Hi
On given storage server - source - enable verbose logging (in bp.conf add VERBOSE = 5), create the log directories by executing mklogdir file located in /usr/openv/netbackup/logs
wait for the job to be restarted - if this is SLP based or kick it off again!
once failed review the bpdm logs and maybe few more - depening what will be in first one.

hamza_h · Answer

also check below:
- services status on destintation storage server (restart if possible)
- check connectivity over ports 10102 &amp; 10082 between targer and source
replication.log would be helpful as well under spoold folder on source.

johnney · Answer

Thanks Quebek,This is a windows server 2016, where do i enable verbose logging in windows (storage server)bptestbpcd from master to client is oksame to client is okI have restarted the service but still

johnney · Answer

Hello Hamza_Hhave restarted sametelnet at both ends is also fine but still with error

Forum Discussion

no images were successfully processed (191)

Related Content

no images were successfully processed (191)

no images were successfully processed(191)

no images were successfully processed 191

No images were successfully processed (191)

Phase 2 import fails - no images were successfully processed