Image cleanup jobs failing with "media manager - system error occurred(174)" and backups jobs failing with "media open error(83)"

Can you post a bpps and crcontrol --dsstat from your storage server please.

Was there more than one backup done for this client? Mixed case in client name for the different backups?

I had the same error when I ran a backup for my laptop as Marianne-Win7 as Client name, and then a couple of weeks later as marianne-win7:

05/08/2013 17:06:54 - begin writing
05/08/2013 17:06:55 - Critical bptm (pid=11991) image open failed: error 2060029: authorization failure
05/08/2013 17:07:01 - Critical bptm (pid=11991) sts_close_server failed: error 2060057 OpenStorage Proxy Plugin Error
05/08/2013 17:07:01 - Critical bptm (pid=11991) sts_get_server_prop failed: error 2060057 OpenStorage Proxy Plugin Error
05/08/2013 17:07:59 - Info bptm (pid=11991) EXITING with status 83 <----------

Fixed when I created a symbolic link on the appliance in dedupe database folder:
 

cd /disk/databases/catalog/2

Hi

[root@server 2]# crcontrol --dsstat
************ Data Store statistics ************
Data storage      Raw    Size   Used   Avail  Use%
                  34,0T  32,7T  17,4T  15,2T  54%
Number of containers             : 139420
Average container size           : 180050943 bytes (171,71MB)
Space allocated for containers   : 25102702483401 bytes (22,83TB)
Space used within containers     : 24643599549191 bytes (22,41TB)
Space available within containers: 459102934210 bytes (427,57GB)
Space needs compaction           : 6003808602015 bytes (5,46TB)
Reserved space                   : 1511901052928 bytes (1,38TB)
Reserved space percentage        : 4,0%
Records marked for compaction    : 152153556
Active records                   : 285180597
Total records                    : 437334153

[root@server 2]# bpps
root      5174     1  0 10:29 ?        00:00:00 /usr/openv/netbackup/bin/vnetd -standalone
root      5181     1  0 10:29 ?        00:00:00 /usr/openv/netbackup/bin/bpcd -standalone
root      5298     1  0 10:29 ?        00:00:33 /usr/openv/pdde/pdcr/bin/spad
pddb      5488     1  0 10:29 ?        00:00:00 /usr/openv/pdde/pddb/bin/postmaster -D /deduplication/databases/pddb/data -N 512 -B 1024 -i -p10085
root      5851     1 33 10:30 ?        01:59:37 /usr/openv/pdde/pdcr/bin/spoold
root      5918     1  0 10:30 ?        00:00:00 /usr/openv/netbackup/bin/bpcompatd
root      5951     1  0 10:30 ?        00:00:08 /usr/openv/netbackup/bin/nbrmms
root      6000     1  0 10:30 ?        00:00:17 /usr/openv/netbackup/bin/nbsl
root      6046     1  0 10:30 ?        00:00:01 /usr/openv/netbackup/bin/nbcssc -a NetBackup
root      6071     1  0 10:30 ?        00:00:02 /usr/openv/netbackup/bin/nbsvcmon
root      6431  5951  0 10:31 ?        00:00:11 /usr/openv/netbackup/bin/admincmd/bpstsinfo -DPSPROXY
 

Thank you for your time

Best Regards

Hello,

Was there more than one backup done for this client? Mixed case in client name for the different backups?

Yes, there are several polices running for this server:

• Normal backup policy: system state, C: and D: drives. This one runs without problems
• Customized backup for drive K: which contains many PSTs files. This one is the failing one

It seems the same error you described, but I have already checked the path you provided and soft links already exists

drwx------ 12 root root 4096 may  2 09:50 svpfil05
lrwxrwxrwx  1 root root    8 may 10 13:04 SVPFIL05 -> svpfil05
lrwxrwxrwx  1 root root    8 may 11 10:44 svpfil05.domain.tld -> svpfil05
lrwxrwxrwx  1 root root    8 may 11 10:44 SVPFIL05.domain.tld -> svpfil05

Did you have the same problem with the Image cleaup jobs?

Thank you for your time

Best regards

OK - I have seen this get even worse recently!

First it must be said that client names in policies using mixed case with MSDP is not classed as unsupported so you do need to actually sort those out

Next, go one step deeper into the catalog

Inside the clients folder you will see a folder with the policy name (and if i remeber right the schedule name is under that (maybe!)

Her you can get an issue if a policy has been re-created so look carefully at the current policy name and see if it is in exactly the same case as the current folders - you may need to create soft links within the client folders too

Hope this helps - all confusing and really hard to spot the error - sometime you need to look at the actual image name and how that relates to the folder names to spot where the difference is and how the softlink needs to be done

Hello

I have checked the policy names and they are the same in the netbackup console and in the /deduplication/databases/catalog/2/svpfil05 path.

The failing backup policy is win_prod_PST (special policy por PSTs files) and the other policy that runs OK  in this server is Win_Prod_Daily (standard policy for C:/D: drives and System State)

Within the Win_Prod_Daily folder there are several files named as the failing image in the Image cleanup jobs

17/05/2013 06:29:18 - Critical bpdm(pid=7511) sts_delete_image of image svpfil05_1363977060_C1_F1 failed: error 2060029 authorization failure

./win_prod_PST/svpfil05_1363977060_C1_F1.info
./win_prod_PST/svpfil05_1363977060_C1_F1.img
./win_prod_PST/svpfil05_1363977060_C1_F1.hdr
./win_prod_PST/svpfil05_1363977060_C1_F1.map
./win_prod_PST/svpfil05_1363977060_C1_F2.img
./win_prod_PST/svpfil05_1363977060_C1_F2.hdr
./win_prod_PST/svpfil05_1363977060_C1_F2.map
./win_prod_PST/svpfil05_1363977060_C1_HDR.img

The bizarre thing about this is that the failing policy folders doesn't have these folders. They are located in the policy that runs OK

Any other Idea?

Thank you for your time

Best Regards

Sounds like your softlinks are not working somewhere then - double check it all again

If they are right then when you look in the upper and lower case folders what you see should be the same

If you cannot see the failing policy folder then you need to search for them - there may be yet another folder that needs to be softlinked

So you may have svpfil05, Svpfil05 and svpFil05 or similar if you see what i mean

Hope this helps

Hi

At server name folder level, soft link seem to work fine:

[root@ochlp-bak002 2]# ls -l|grep svpfil05
drwx------ 12 root root 4096 may  2 09:50 svpfil05
lrwxrwxrwx  1 root root    8 may 10 13:04 SVPFIL05 -> svpfil05
lrwxrwxrwx  1 root root    8 may 11 10:44 svpfil05.domain.tld -> svpfil05
lrwxrwxrwx  1 root root    8 may 11 10:44 SVPFIL05.domain.tld -> svpfil05
[root@ochlp-bak002 2]# cd SVPFIL05
[root@ochlp-bak002 SVPFIL05]# pwd
/deduplication/databases/catalog/2/SVPFIL05
[root@ochlp-bak002 SVPFIL05]# ls
__dirpo__       Win_Prod_Daily1              Win_Prod_Daily_NoAccel   win_prod_PST    win_prod_PST_2        Win-prueba
Win_Prod_Daily  Win_Prod_Daily_Fax_No_Accel  Win_Prod_Daily_svpfil05  win_prod_PST_1  win_prod_PST_Archive

[root@ochlp-bak002 SVPFIL05]# cd ..
[root@ochlp-bak002 2]# cd svpfil05.domain.tld
[root@ochlp-bak002 svpfil05.domain.tld]# pwd
/deduplication/databases/catalog/2/svpfil05.domain.tld
[root@ochlp-bak002 svpfil05.domain.tld]# ls
__dirpo__       Win_Prod_Daily1              Win_Prod_Daily_NoAccel   win_prod_PST    win_prod_PST_2        Win-prueba
Win_Prod_Daily  Win_Prod_Daily_Fax_No_Accel  Win_Prod_Daily_svpfil05  win_prod_PST_1  win_prod_PST_Archive
[root@ochlp-bak002 svpfil05.domain.tld]# cd ..

[root@ochlp-bak002 2]# cd SVPFIL05.domain.tld
[root@ochlp-bak002 SVPFIL05.domain.tld]# ls
__dirpo__       Win_Prod_Daily1              Win_Prod_Daily_NoAccel   win_prod_PST    win_prod_PST_2        Win-prueba
Win_Prod_Daily  Win_Prod_Daily_Fax_No_Accel  Win_Prod_Daily_svpfil05  win_prod_PST_1  win_prod_PST_Archive

At policy name folder level:

[root@ochlp-bak002 SVPFIL05.domain.tld]# ls -ltr
total 484
-rw-r----- 1 root root     76 dic  8 17:33 __dirpo__
drwx------ 2 root root     22 dic  8 19:00 Win_Prod_Daily1
drwx------ 2 root root     22 mar 10 10:36 Win-prueba
drwx------ 2 root root  40960 abr 20 22:10 win_prod_PST_1
drwx------ 2 root root  40960 abr 22 02:03 win_prod_PST_2
drwx------ 2 root root     22 abr 24 19:39 Win_Prod_Daily_Fax_No_Accel
drwx------ 2 root root   4096 abr 25 13:08 Win_Prod_Daily_NoAccel
drwx------ 2 root root  12288 may 10 01:13 win_prod_PST_Archive
drwx------ 2 root root 131072 may 16 06:36 Win_Prod_Daily_svpfil05
drwx------ 2 root root 184320 may 16 23:49 win_prod_PST
drwx------ 2 root root   8192 may 17 11:44 Win_Prod_Daily

at policy name catalog level:

[root@ochlp-bak002 SVPFIL05.domain.tld]# bppllist |grep Win_Prod_Daily
Win_Prod_Daily
Win_Prod_Daily1
Win_Prod_Daily10
Win_Prod_Daily2
Win_Prod_Daily3
Win_Prod_Daily4
Win_Prod_Daily5
Win_Prod_Daily6
Win_Prod_Daily7
Win_Prod_Daily8
Win_Prod_Daily9
Win_Prod_Daily_Fax_No_Accel
Win_Prod_Daily_NoAcel
Win_Prod_Daily_Tape
Win_Prod_Daily_svpfil05
Win_Prod_Daily_test
[root@ochlp-bak002 SVPFIL05.domain.tld]# bppllist |grep win_prod_PST
win_prod_PST
win_prod_PST_1
win_prod_PST_2
win_prod_PST_Archive

So they have the same policy name too. ¿? I don't see any differences.

Thank you for your time

I did not have any image cleanup failure as my first backup with lowercase name failed.

It took me overnight to remember Mark's similar experience.
I immediately created the symlink in the dedupe database folder as well as in /usr/openv/netbackup/db/images folder.
Subsequent backups and image cleanups were successful.
Sorry if that doesn't help you.

In order to work around the problem with policy win_prod_PST I have copied it to a renamed one win_prod_PST_svpfil05. This workaround works ok but The problem is still there.