command failed: none of the requested files were backed up (2)

[Zahid_Haseeb]

Environment

OS = windows 2008 Server

Netbackup Server version = 7.1

Query

Netbackup was taking backup successfully till last SAT. Now the same policy is failing. Below is for reference:

Activity Monitor

2/4/2013 10:25:29 AM - Info nbjm(pid=2272) starting backup job (jobid=161775) for client SYSTEM_NAME, policy SightDBNew, schedule Full 

2/4/2013 10:25:29 AM - Info nbjm(pid=2272) requesting MEDIA_SERVER_WITH_ATTRIBUTES resources from RB for backup job (jobid=161775, request id:{CDFB7E79-692A-4967-84D8-703C5662DAE7}) 

2/4/2013 10:25:29 AM - requesting resource NBU-SERVER-hcart-robot-tld-6

2/4/2013 10:25:29 AM - requesting resource NBU-SERVER.NBU_CLIENT.MAXJOBS.SYSTEM_NAME

2/4/2013 10:25:29 AM - requesting resource NBU-SERVER.NBU_POLICY.MAXJOBS.SightDBNew

2/4/2013 10:25:29 AM - granted resource NBU-SERVER.NBU_CLIENT.MAXJOBS.SYSTEM_NAME

2/4/2013 10:25:29 AM - granted resource NBU-SERVER.NBU_POLICY.MAXJOBS.SightDBNew

2/4/2013 10:25:29 AM - granted resource NBU-SERVER-hcart-robot-tld-6

2/4/2013 10:25:29 AM - estimated 0 Kbytes needed

2/4/2013 10:25:29 AM - Info nbjm(pid=2272) started backup job for client SYSTEM_NAME, policy SightDBNew, schedule Full on storage unit NBU-SERVER-hcart-robot-tld-6

2/4/2013 10:25:30 AM - Info bpbrm(pid=4136) SYSTEM_NAME is the host to backup data from    

2/4/2013 10:25:30 AM - Info bpbrm(pid=4136) reading file list from client       

2/4/2013 10:25:30 AM - started process bpbrm (4136)

2/4/2013 10:25:30 AM - connecting

2/4/2013 10:25:35 AM - Info bpbrm(pid=4136) starting bphdb on client        

2/4/2013 10:25:35 AM - connected; connect time: 00:00:05

2/4/2013 10:25:38 AM - Info bphdb(pid=2028) Backup started          

2/4/2013 10:25:41 AM - Info dbclient(pid=5992) INF - BACKUP STARTED USING       

2/4/2013 10:25:41 AM - Info dbclient(pid=5992) Microsoft SQL Server 2005 - 9.00.1399.06 (Intel X86)    

2/4/2013 10:25:41 AM - Info dbclient(pid=5992) Oct 14 2005 00:33:37        

2/4/2013 10:25:41 AM - Info dbclient(pid=5992) Copyright (c) 1988-2005 Microsoft Corporation       

2/4/2013 10:25:41 AM - Info dbclient(pid=5992) Developer Edition on Windows NT 5.2 (Build 3790: Service Pack 2) 

2/4/2013 10:25:41 AM - Info dbclient(pid=5992) Batch = C:\Program Files\VERITAS\NetBackup\DbExt\MsSql\SightDBFull.bch, Op# = 1     

2/4/2013 10:25:41 AM - Info dbclient(pid=5992) INF - Using backup image SYSTEM_NAME.MSSQL7.SYSTEM_NAME.db.SightDB.~.7.001of001.20130204102539..C      

2/4/2013 10:25:41 AM - Info dbclient(pid=5992) INF - backup database "SightDB" to VIRTUAL_DEVICE='VNBU0-5992-4240-1359955540' with  stats = 10, blocksize = 65536, maxtransfersize = 4194304, buffercount = 2

2/4/2013 10:25:41 AM - Info dbclient(pid=5992) INF - Number of stripes: 1, Number of buffers per stripe 2.

2/4/2013 10:25:41 AM - Info dbclient(pid=5992) INF - Created VDI object for SQL Server instance <SYSTEM_NAME>. Connection timeout is <300> seconds.

2/4/2013 10:38:18 AM - Info dbclient(pid=5992) ERR - Error in VxBSASendData: 1.      

2/4/2013 10:38:19 AM - Info dbclient(pid=5992)     CONTINUATION: - All backup jobs have completed. 

2/4/2013 10:38:19 AM - Info dbclient(pid=5992) ERR - Error in DBthreads::dbclient: 6.      

2/4/2013 10:38:19 AM - Info dbclient(pid=5992)     CONTINUATION: - The system cannot find the file specified.

2/4/2013 10:38:19 AM - Info dbclient(pid=5992) ERR - Error in VxBSAEndData: 6.      

2/4/2013 10:38:19 AM - Info dbclient(pid=5992)     CONTINUATION: - The handle used to associate this call with a previous VxBSAInit() call is invalid.

2/4/2013 10:38:23 AM - Info dbclient(pid=5992) ERR - Error in VDS->Close: 0x80770004.      

2/4/2013 10:38:23 AM - Info dbclient(pid=5992)     CONTINUATION: - An abort request is preventing anything except termination actions.

2/4/2013 10:38:24 AM - Info dbclient(pid=5992) INF - OPERATION #1 of batch C:\Program Files\VERITAS\NetBackup\DbExt\MsSql\SightDBFull.bch FAILED with STATUS 1 (0 is normal). Elapsed time = 764(0) seconds.

2/4/2013 10:38:26 AM - Info dbclient(pid=5992) INF - Results of executing <C:\Program Files\VERITAS\NetBackup\DbExt\MsSql\SightDBFull.bch>:     

2/4/2013 10:38:26 AM - Info dbclient(pid=5992) <0> operations succeeded. <1> operations failed.      

2/4/2013 10:38:26 AM - Info dbclient(pid=5992) INF - The following object(s) were not backed up successfully.  

2/4/2013 10:38:26 AM - Info dbclient(pid=5992) INF - SightDB         

2/4/2013 10:38:26 AM - Error bpbrm(pid=4136) from client SYSTEM_NAME: ERR - command failed: none of the requested files were backed up (2)

2/4/2013 10:38:26 AM - Error bpbrm(pid=4136) from client SYSTEM_NAME: ERR - bphdb exit status = 2: none of the requested files were backed up

2/4/2013 10:38:28 AM - end writing

none of the requested files were backed up(2)

2/4/2013 10:38:33 AM - Info bphdb(pid=2028) done. status: 2: none of the requested files were backed up

=====

====

[Zahid_Haseeb]

DBclient log:

11:28:14.110 [2392.7380] <2> vnet_pbxConnect: pbxConnectEx Succeeded

11:28:14.110 [2392.7380] <2> logconnections: BPRD CONNECT FROM 10.10.2.13.63290 TO 10.10.2.13.1556 fd = 612

11:28:14.188 [2392.7380] <4> CGlobalInformation::VCSVirtualNameList: INF - Veritas Cluster Server is not installed.

11:28:14.188 [2392.7380] <1> CGlobalInformation::VCSVirtualNameList:     CONTINUATION: - The system cannot find the path specified.

11:28:14.196 [2392.7380] <4> getServerName: Read server name from nb_master_config: NBU-SERVER

11:28:14.196 [2392.7380] <4> CDBIniParms::CDBIniParms: INF - NT User is Administrator

11:28:14.345 [2392.7380] <4> DBConnect: INF - Logging into SQL Server with DSN <NBMSSQL_temp_2392_7380_1>, SQL userid <sa> handle <0x01448cb0>.

11:28:14.613 [2392.7380] <4> CGlobalInformation::CreateDSN: INF - A successful connection to SQL Server <NBU-SERVER\DLO> has been made using standard security with DSN <NBMSSQL_temp_2392_7380_1>

11:28:14.613 [2392.7380] <4> DBDisconnect: INF - Logging out of SQL Server with handle <0x01448cb0>

11:28:14.614 [2392.7380] <4> DBConnect: INF - Logging into SQL Server with DSN <NBMSSQL_temp_2392_7380_1>, SQL userid <sa> handle <0x01448cb0>.

11:28:15.178 [2392.7380] <4> DBDisconnect: INF - Logging out of SQL Server with handle <0x01448cb0>

11:28:20.424 [2392.7380] <4> DBConnect: INF - Logging into SQL Server with DSN <NBMSSQL_2392_7380_2>, SQL userid <sa> handle <0x01448cb0>.

11:28:20.434 [2392.7380] <4> CGlobalInformation::CreateDSN: INF - A successful connection to SQL Server <NBU-SERVER\DLO> has been made using standard security with DSN <NBMSSQL_2392_7380_2>

11:28:20.434 [2392.7380] <4> DBDisconnect: INF - Logging out of SQL Server with handle <0x01448cb0>

11:28:20.435 [2392.7380] <4> DBConnect: INF - Logging into SQL Server with DSN <NBMSSQL_2392_7380_2>, SQL userid <sa> handle <0x01448cb0>.

11:28:21.500 [2392.7380] <4> DBDisconnect: INF - Logging out of SQL Server with handle <0x01448cb0>

11:28:21.521 [2392.7380] <4> StartupProcess: INF - Starting: <C:\Program Files\Veritas\NetBackup\bin\admincmd\bppllist.exe -byclient NBU-SERVER>

11:28:31.528 [2392.7380] <16> StartupProcess: ERR - Timed out waiting for process to end : <C:\Program Files\Veritas\NetBackup\bin\admincmd\bppllist.exe -byclient NBU-SERVER>.

11:28:31.528 [2392.7380] <1> StartupProcess:     CONTINUATION: - The system cannot find the file specified.

11:28:31.528 [2392.7380] <8> CDBbackupView::ClassDropDownList: WARN - Error in StartupProcess: Command String: C:\Program Files\Veritas\NetBackup\bin\admincmd\bppllist.exe -byclient NBU-SERVER

11:28:31.528 [2392.7380] <8> CBackupDBDlg::OnInitDialog: WARN - Policy Dropdown not created: Server = NBU-SERVER, Client = NBU-SERVER

11:28:31.528 [2392.7380] <1> CBackupDBDlg::OnInitDialog:     CONTINUATION: - The process cannot access the file because it is being used by another process.

11:29:37.088 [2392.7380] <4> CGlobalInformation::DeleteDSN: INF - Error removing ODBC data source name DSN=NBMSSQL_temp_2392_7380_1

11:29:37.088 [2392.7380] <1> CGlobalInformation::DeleteDSN:     CONTINUATION: - Invalid DSN

11:29:37.088 [2392.7380] <1> CGlobalInformation::DeleteDSN:     CONTINUATION: - Driver's ConfigDSN, ConfigDriver, or ConfigTranslator failed

[RamNagalla]

11:28:31.528 [2392.7380] <16> StartupProcess: ERR - Timed out waiting for process to end : <C:\Program Files\Veritas\NetBackup\bin\admincmd\bppllist.exe -byclient NBU-SERVER>

it looks like bppllist.exe is taking to much time to run.

just run the command bpplist.exe and see how much time its taking to compleated the command.

I would say, if its taking , restart your Netbackup Master server and try again.

if its still not let us know.

[Zahid_Haseeb]

Thanks Nagalla

Let me do it and will share the result.

[Zahid_Haseeb]

I ran the bppllist command and got an instant output.

Yesterday my client also restarted the NBU Server and CLient as well.

[Marianne]

bppllist is only run on NBU master server.

Seems client is requesting info from master and this comms process is timing out.

Logs needed:

On master: bprd

On media server: bptm and bpbrm

On client: dbclient and bpcd

Please rename files to match process name and post as File attachment.

A couple of things to check that could have changed and now causing backups to fail:

1. Demo and/or NFR license key has expired, making policy type invalid

2. NBU Client Service logon account on the client.

[Zahid_Haseeb]

Sorry for not sharing further information in this regards. I talked to my client and he said that he low the UAC of windows and restarted the node, which resolved the problem.

Thanks to all for kind support