Job Status 1 on many polisys

[Kristoffer_Lie]

Hello. 

I need a little help solving my status 1 jobs.

My setup is like this:

Master server: Win2008 - Netbackup 7.6.1

Media server: Win2008 - Netbackup 7.6.1

Job setup: File backup ( windows ), path is set to \\servername\driveletter$\foldername 

( due to reason failure i changed it to this path when the restore did not list all my folders when using the normal browse button and selectin drive to backup. )

After i changed it it now shows me status 1 with diffrent WRN messages and errors. 

For exsample:

06.08.2015 04:01:12 - Warning bpbrm(pid=5656) from client aprefs05: WRN - can't open file: \\APREFS05\C$\pagefile.sys (WIN32 32: Unknown error)
06.08.2015 04:01:13 - Warning bpbrm(pid=5656) from client aprefs05: WRN - can't open file: \\APREFS05\C$\Program Files\Microsoft Monitoring Agent\Agent\Health Service State\Health Service Store\edb.log (WIN32 32: Unknown error)
06.08.2015 04:01:14 - Warning bpbrm(pid=5656) from client aprefs05: WRN - can't open file: \\APREFS05\C$\Program Files\Microsoft Monitoring Agent\Agent\Health Service State\Health Service Store\edbtmp.log (WIN32 32: Unknown error)
06.08.2015 04:01:14 - Warning bpbrm(pid=5656) from client aprefs05: WRN - can't open file: \\APREFS05\C$\Program Files\Microsoft Monitoring Agent\Agent\Health Service State\Health Service Store\HealthServiceStore.edb (WIN32 32: Unknown error)
06.08.2015 04:01:14 - Warning bpbrm(pid=5656) from client aprefs05: WRN - can't open file: \\APREFS05\C$\Program Files\Microsoft Monitoring Agent\Agent\Health Service State\Health Service Store\tmp.edb (WIN32 32: Unknown error)
06.08.2015 04:01:17 - Warning bpbrm(pid=5656) from client aprefs05: WRN - can't open file: \\APREFS05\C$\System Volume Information\SRM\quota.md (WIN32 32: Unknown error)
06.08.2015 04:01:17 - Warning bpbrm(pid=5656) from client aprefs05: WRN - can't open file: \\APREFS05\C$\System Volume Information\Syscache.hve (WIN32 32: Unknown error)
06.08.2015 04:01:17 - Warning bpbrm(pid=5656) from client aprefs05: WRN - can't open file: \\APREFS05\C$\System Volume Information\Syscache.hve.LOG1 (WIN32 32: Unknown error)
06.08.2015 04:01:43 - Warning bpbrm(pid=5656) from client aprefs05: WRN - can't open file: \\APREFS05\C$\Windows\ServiceProfiles\LocalService\AppData\Local\lastalive0.dat (WIN32 32: Unknown error)
06.08.2015 04:01:43 - Warning bpbrm(pid=5656) from client aprefs05: WRN - can't open file: \\APREFS05\C$\Windows\ServiceProfiles\LocalService\AppData\Local\lastalive1.dat (WIN32 32: Unknown error)
06.08.2015 04:01:43 - Info bpbrm(pid=5656) from client aprefs05: TRV - last message being suppressed after 10 occurrences 
06.08.2015 04:31:33 - Info bptm(pid=3360) waited for full buffer 1447 times, delayed 117074 times    
06.08.2015 04:31:35 - Info bptm(pid=3360) EXITING with status 0 <----------        
06.08.2015 04:31:35 - Info bpbrm(pid=5656) validating image for client aprefs05        
06.08.2015 04:31:38 - Info bpbkar32(pid=3152) done. status: 1: the requested operation was partially successful    
06.08.2015 04:31:38 - end writing; write time: 0:30:32
the requested operation was partially successful (1)

and

03.08.2015 09:55:17 - Info bptm(pid=5640) start            
03.08.2015 09:55:17 - begin writing
03.08.2015 10:36:07 - Error bpbrm(pid=6344) from client iktlfs10: ERR - failure reading file: \\IKTLFS10\F$\HOME\IreLarnr1t\epost\OutlookIrene.pst (WIN32 33: Unknown error)
03.08.2015 10:49:21 - Warning bpbrm(pid=6344) from client iktlfs10: WRN - can't open file: \\IKTLFS10\F$\HOME\thedankons\7 Nord\01 Nordlys\~$2015 Google inntekt.xlsx (WIN32 32: Unknown error)
03.08.2015 10:56:28 - Warning bpbrm(pid=6344) from client iktlfs10: WRN - can't open file: \\IKTLFS10\F$\HOME\vibberfolk\ROTE-BOD\Trasoptunet\~$budsjett_ny.xlsx (WIN32 32: Unknown error)
03.08.2015 11:01:07 - Info bptm(pid=7080) waited for full buffer 46634 times, delayed 253085 times    
03.08.2015 11:01:09 - Info bptm(pid=7080) EXITING with status 0 <----------        
03.08.2015 11:01:09 - Info bpbrm(pid=6344) validating image for client iktlfs10        
03.08.2015 11:01:13 - Info bpbkar32(pid=91752) done. status: 1: the requested operation was partially successful    
03.08.2015 11:01:13 - end writing; write time: 1:05:56
the requested operation was partially successful (1)

This jobs are just a small part of alle the diffrent errors i get. ( status 1 )

I have also tryed to exclude the files i dont need, but it looks like i have to use \\servername\driveletter$\filename there to?  

[Kristoffer_Lie]

Here is a example on why i have to use \\servername\driveletter$\folder
 

[RiaanBadenhorst]

How long did the job run when you didn't use the \\servername method?

I think your snapshot copy got removed and therefore you got the

WRN - can't open file: \\APREFS05\C$\Windows\ServiceProfiles\LocalService\AppData\Local\lastalive1.dat (WIN32 32: Unknown error)

You could check your event viewer (app/sys) for VSS / Volsnap errors duing the backup time.

The reason it works when you use the mapped method is that VSS is not used for the backup and NetBackup can grab all the files.

[Nicolai]

Try changeing file path to ALL_LOCAL_DRIVES and check mark "cross mount points" in the policy

Also be aware of junction points if used - data may be somwhere else in the file system.

http://www.symantec.com/docs/TECH72326

Not to sound as a gumpy old man, but youre way of using \\servers\$drive is not the way netbackup usally configured.

We will try to helpy you out :)

[Kristoffer_Lie]

The job did run for some months befor i needed a restore and found out that the restore was not possible ( as my last picture in last post shows ) Thats why i changed it to \\servername\driveletter$\...

but in standard file backup, the right way to do backup is to use the browse button and select the drives/folders you need backed up right? why do i then get this "bug" when trying to restore the files? I cant trust the browse function anymore.  its to important files to "think" is ok... 

How do i fix it? and why is it like this?


( sorry for my bad eng and little understanding of this... pretty new to this kind of errors )

[Kristoffer_Lie]

To Nicolai:   hehe. i understand what you mean. no harm done ;)

I cant choose all lokal drives ;)   Its a file server with many TB of files.. the backup job will then last for weeks....  thats why i have to split it up into 2 jobs.   1 for D:\ and 1 for c:\, e:\ f:\ g:\

How do cross mount points work?

I do want to use the defaul way ( c:\folder\file - the browse menu ) but how can i trust it? I cant check all of my jobs evry day manualy and i cant trust the status 0 on the job... hehe

[sdo]

Kristoffer, is the data protected/replicated by DFSR?

[Kristoffer_Lie]

sdo:  Yes.  Its DFS.  ( i dont know if its protected/replicated tho....   )

[RiaanBadenhorst]

For DFS you need to backup the shadow copy components, not E:\ or \\servername

SDO has the most information about this.

[Kristoffer_Lie]

Ahh ok..  i "think" i understand....  but if i now want to take backup of this, i shoud set it up without D:\  and just use shadowcopy?

I can see my folders under ( in BAR ) shadow copy components but 1 folder is missing and it list folders from other drives to ( e:\ f:\ ). 

Lets take an example:

My D:\ contains this folders:   annprod, atekscripts, produksjon.

My BAR shaddow copy comopnents shows this: atekscripts, data, felles, produksjon, prog.

How do i spesify in the policy that it is annprod and produksjon i want backup of?  

[RiaanBadenhorst · Accepted solution]

PLease take a look at this note, its explains it well.

https://support.symantec.com/en_US/article.HOWTO65638.html

[Kristoffer_Lie]

That answer my question i think..  Will now change all my jobs/policys and test it out. 

Im posting back after testing it out and then mark a post as SOLUTION ;)

Thanks to all of you.  

[Nicolai]

Told you we would help you out :D

[Nicolai]

I am answer in between posts - to answer youre qustion. From the thread I can see this is DFS-R , but if this was non dfs-r data:

Create on policy e.g: WIN_FS use  ALL_LOCAL_DRIVES as directive - create a policy specific exclude list for data drive e.e e:\

Create yet a new policy .e.g WIN_FS_BIGDATA - use e:\*  or somthing like

e:\data1\*

e:\data2\*

and checkmark "allow multimple streams". This concept usally work well for server with lot of data.The number of directories just below e:\ has to be limited else you will spawn a backup job per directory - and imageing if 300 directories are below e:\

Cross Mount point:

Netbackup will not backup subdisk "cross mount points are marked". Imageing the following:

e:\data\

A disk is then unix style mounted on e:\data\VIP in Windows.

Without "cross mount point" Netbackup will backup e:\data but not VIP, if "cross mount points" is enabled e:\data\VIP is target for backup. Small but important setting.

[sdo]

You can still leave plain client backups to pass over the DFS areas - which will simply be auto excluded from plain client backups - hence you couldn't see the folders in plain client restore.   Let the NetBackup Client backup of SCC: (Shadow_Copy_Components:) do it's thing and you should be ok.  You probably don't want to not backup D: because you probably have other data/folders/files on that volume that need to be backed-up.  And, you don't need to exclude the DFS(R) protected folders as NetBackup Client will do that for you.

The TN Riaan posted describes it well.

[Kristoffer_Lie]

Here is the result of the SCC backup last week.  Status 1 :(

I have also included pictures of the policy
 

06.08.2015 16:08:18 - begin writing
06.08.2015 21:14:37 - Warning bpbrm(pid=4984) from client aprefs03: WRN - can't open file: Shadow Copy Components:\User Data\Distributed File System Replication\DfsrReplicatedFolders\Produksjon\AvisaNordland\AN-Design jobber\Flygt eiendom\~lokaler til leie s~q3aj6h.idlk (WIN32 32: Unknown error)
07.08.2015 12:13:37 - Warning bpbrm(pid=4984) from client aprefs03: WRN - can't open file: Shadow Copy Components:\User Data\Distributed File System Replication\DfsrReplicatedFolders\Produksjon\Nordhordland\Dagens Avis\2015\08 August\01. august\~meca2~n-74hf.idlk (WIN32 32: Unknown error)
08.08.2015 05:14:10 - Info bptm(pid=4732) waited for full buffer 6568571 times, delayed 8551810 times    
08.08.2015 05:14:13 - Info bptm(pid=4732) EXITING with status 0 <----------        
08.08.2015 05:14:15 - Info bpbrm(pid=4984) validating image for client aprefs03        
08.08.2015 05:14:21 - Info bpbkar32(pid=3292) done. status: 1: the requested operation was partially successful    
08.08.2015 05:14:21 - end writing; write time: 37:06:03
the requested operation was partially successful (1)

[Nicolai]

What are idlk files ?

Please note that VSS in some circumstance can't backup open files files if they are made by applications (aka application/ processed locked files). VSS is primarily intended to ptotect systetm files (AKA MS files).

If the file isn't neede , consider to exclude it from backup if possible.

[Kristoffer_Lie]

The files are Indesign files. I do not know at this time if we need it. 

If we dont need it ill exclude them from backup.  But what can i do IF we need them ? 

Detailed information for file extension IDLK:

---

Primary association: InDesign

Company: Adobe Systems Incorporated

Program ID: InDesign.Lock File

And shoud i make a policy for each setup. Like this:

1:  A policy for Shadow Copy Components:\User Data\Distributed File System Replication\DfsrReplicatedFolders\Produksjon of my DFS(R) folder.

2:  A policy with D:\folder name ( the remaining folder that is not DFS )

Or can i put it like this:  

Shadow Copy Components:\User Data\Distributed File System Replication\DfsrReplicatedFolders\Produksjon

D:\Folder name

?

Is there any other reqomended way to do this as simple and safe as possible? 

[Kristoffer_Lie]

I have now check the files and it looks like i can exclude this files.  

But how can i exclude the .idlk file from 

Shadow Copy Components:\User Data\Distributed File System Replication\DfsrReplicatedFolders\Produksjon ?

I know where to exclude it but the files keep changing so i need to take all files ending with .idlk ( aka *.idlk )

[sdo]

AFAIK - NetBackup backups of SCC: (Shadow_Copy_Components:) do not process/honour the NetBackup Client side exclusion list.

And, even Microsoft's own 'FilesNotToBackup' registry key is not honoured for System_State (aka SCC:) backups usings Windows backup:

https://msdn.microsoft.com/en-us/library/windows/desktop/bb891959(v=vs.85).aspx

If MS don't support exclusions from their own shadow based backups, then NetBackup won't either.

.

Perhaps your only option is to place the ".idlk" files on another DFSR share, and then modify youur backup policies to not backup that DFRS share which contains the ".idlk" files.