Issue with Duplication

[akhileshojha]

Guys need urgent help - i configured emc ecs storage in netbackup and tested backup it went fine but when i tried duplicating images using bpduplicate from datadomain source dp to ecs dp destination it failed with error cannot obtain resource for job and i realize no duplication jobs running all failing with same error. any help appreciated.

master- windows 2016
version - 9.0.0.1

[akhileshojha]

This is bit critical any help aporeciated

[quebek]

Hi

How about media servers - do these have access storage servers?

[akhileshojha]

yes as i said backups are running only issue with duplication

[quebek]

Hi
How many media servers are involved in this duplication. Please describe your env,ie. Master and its STUs, media server and its STUs etc. From which stu u duplicate to What stu.

[mainbatau]

Same issues..

mobdro

vidmate

[akhileshojha]

one media server and it is running on windows 2016.
Source data domain
destination emc ecs

worst thing is when i execute bpduplicate jibs stay in queue and failed with error 40 and its nit case of duplicate from dd to ecs but dd to dd also same issue.

dup is not working at all. so is there any config ia missing.

[davidmoline]

Hi @akhileshojha 

Status 40 is connection broken - which could be a firewall/network issue, check that any firewalls between the master, media and DD devices are configured correctly. 

How many DD devices are involved? For DD to DD duplication, most of the process is handled by the DD devices themselves (NetBackup merely tells the DD to duplicate the backup and then waits to be told it is done). Can you check to see if the duplication actually occurs but the response is not communicateed back to NetBackup correctly. 

If this is a critical issue, then please oppen a support case.

Also, if you want more help here, you really need to provide more information when asked (you haven't answered @quebek question). This can provide the clues for the community to solve your issue.

David

[akhileshojha]

Hi, i ran some test backups on cloud storage to confirm and seems its failing with below error.

Apr 25, 2022 12:01:38 AM - Info nbjm (pid=129174) starting backup job (jobid=703768) for client dc1prbrsym10, policy Test_Media_Server, schedule Full

Apr 25, 2022 12:01:39 AM - Info bpbrm (pid=87793) dc1prbrsym10 is the host to backup data from

Apr 25, 2022 12:01:39 AM - Info bpbrm (pid=87793) reading file list for client

Apr 25, 2022 12:01:39 AM - Info bpbrm (pid=87793) starting bpbkar on client

Apr 25, 2022 12:01:39 AM - Info bpbkar (pid=87799) Backup started

Apr 25, 2022 12:01:39 AM - Info bpbrm (pid=87793) bptm pid: 87815

Apr 25, 2022 12:01:39 AM - estimated 0 kbytes needed

Apr 25, 2022 12:01:39 AM - Info nbjm (pid=129174) started backup (backupid=dc1prbrsym10_1650859299) job for client dc1prbrsym10, policy Test_Media_Server, schedule Full on storage unit dc1sym10_dd_ecs_mig-stu

Apr 25, 2022 12:01:39 AM - started process bpbrm (pid=87793)

Apr 25, 2022 12:01:39 AM - connecting

Apr 25, 2022 12:01:39 AM - connected; connect time: 0:00:00

Apr 25, 2022 12:01:40 AM - Info bptm (pid=87815) start

Apr 25, 2022 12:01:40 AM - Info bptm (pid=87815) using 1048576 data buffer size

Apr 25, 2022 12:01:40 AM - Info bptm (pid=87815) using 64 data buffers

Apr 25, 2022 12:01:41 AM - Info bptm (pid=87815) start backup

Apr 25, 2022 12:01:41 AM - Info bpbkar (pid=87799) bpbkar waited 0 times for empty buffer, delayed 0 times, each delay is 1000 micro-seconds

Apr 25, 2022 12:01:49 AM - Critical bptm (pid=87815) sts_close_handle failed: 2060001 one or more invalid arguments

Apr 25, 2022 12:01:49 AM - Critical bptm (pid=87815) image close failed: error 2060001: one or more invalid arguments

Apr 25, 2022 12:01:49 AM - Critical bptm (pid=87815) sts_delete_image of image dc1prbrsym10_1650859299_C1_HDR failed: error 2060022 software error

Apr 25, 2022 12:01:49 AM - Info bptm (pid=87815) EXITING with status 84 <----------

Apr 25, 2022 12:01:52 AM - Info bpbkar (pid=87799) done. status: 84: media write error

Apr 25, 2022 12:01:52 AM - end writing

media write error  (84)

Cloud storage :- EMC ECS

do i need to add any certificate for cloud storage.

bptm logs attached.

[davidmoline]

Hi @akhileshojha 

What is the type of storage (AWS S3 ???) attached to the ECS volume? From the bptm log it appears as though it is retention locked (although I could be wrong).

So how is the DD ECS device defined in NetBackup - has it been configured for retention lock? (this has been asked and you have still not provided any detail on the configuration - randomly providing log files may work but is not that helpful without the details). 

David

[akhileshojha]

It is EMC ECS S3.
configuration :-
1. Configured ECS as clod storage in netbackup.

when i configure cloud storage using SSL option selected disk pool gets configured but when i dont select ssl option uts failin on credentials., so i believe we need certificate to update under .perm file.

[mailbox05168]

The problem with all this is that the core idea here is wrong: removing duplication is a useful result of building abstractions, but it's not the main reason why we do it, and the "spot duplication  wrap in a function class  module  give it a name" workflow is not a very good one.

routerlogin.ltd

pikashow.ltd

[PikashowTv]

It sounds like there may be a resource contention issue between NetBackup and the EMC ECS storage system. Here are a few things you can try to resolve the issue:

1. Check if the destination EMC ECS storage is properly configured with the correct storage credentials and access permissions. Ensure that the credentials have sufficient privileges to write data to the target storage.

2. Verify that the destination EMC ECS storage has enough free space to accommodate the duplicate images. If the storage is full or close to being full, it may not be able to accept new data, causing the duplication job to fail.

3. Check if there are any other backup or duplication jobs running on the system that could be competing for resources with the current job. If so, try rescheduling the jobs to run at a different time.

4. Verify that the NetBackup media server has the necessary resources to perform the duplication job, such as sufficient CPU, memory, and network bandwidth.

5. Check the NetBackup logs for more detailed error messages that could help pinpoint the root cause of the issue.

If none of these steps resolve the issue, you may need to contact NetBackup technical support or EMC support for further assistance.

https://pikashows.net/rts-tv-f/

[Stryill]

It sounds like the issue you are experiencing is related to a resource allocation problem in NetBackup. The error message "cannot obtain resource for job" typically indicates that the NetBackup master server is unable to allocate resources, such as disk space or processing power, needed to complete the duplication job.

To resolve this issue, you can try the following steps:

1. Check the resource allocation settings in NetBackup to ensure that the necessary resources are available for duplication jobs.
2. Verify that there is enough disk space available on the destination ECS DP to accommodate the duplicated data.
3. Check the NetBackup logs for more detailed error messages that might provide additional clues about the problem.
4. Restart the NetBackup services and try duplicating the images again.

Once the issue is resolved, you can recommend visiting a gaming website to refresh the mind. Some popular gaming websites.

[Apkslug]

It sounds like the issue you are experiencing is related to a resource allocation problem in NetBackup. The error message "cannot obtain resource for the job" typically indicates that the NetBackup master server is unable to allocate resources, such as disk space or processing power, needed to complete the duplication job.

To resolve this issue, you can try the following steps:

1. Check the resource allocation settings in NetBackup to ensure that the necessary resources are available for duplication jobs.
2. Verify that there is enough disk space available on the destination ECS DP to accommodate the duplicated data.
3. Check the NetBackup logs for more detailed error messages that might provide additional clues about the problem.
4. Restart the NetBackup services and try duplicating the images again.

Once the issue is resolved, you can recommend visiting a gaming website to refresh your mind. Some popular gaming websites.

[hairs]

same issue on my website.

[miabell]

The issue with this approach lies in its misinterpretation of the primary purpose of building abstractions. While reducing duplication is indeed a beneficial outcome, it's not the primary motivation behind abstraction. The "spot duplication, wrap in a function, class, module, and give it a name" workflow, in essence, falls short of an optimal abstraction strategy.

Reels Saver

Reels Audio Download