VM Backup using SAN Transport mode is failing with SC 71

[N_J]

Backup Media server OS: Suse Linux

Backup Media server: njhp001

Netbackup Version on Backup media server: 7.5.0.7

VCenter Version: 5.1.2

VM OS: Windows 2008

VM name: Backup_Testing

We are trying to backup VM using SAN transport mode and backup is failing with SC 71. Backup Selection is ALL_LOCAL_DRIVE, Policy Type: VMWare.

LUN has been zoned to backup media server and is visible (not mounted)

However, when tried the backup using NBD, backup wwas successful.

___________________________________________

1. File List for the failed job:

FIS_VM_BI_ATTRS_FILE=/online_util/fi_cntl/bpfis.fim.Backup_Testing_1439947668.1.0.NBU_DATA.xml
BACKUP /usr/openv/netbackup/online_util/fi_cntl/bpfis.fim.Backup_Testing_1439947668.1.0.NBU_DATA.xml USING rootfs OPTIONS:FITYPE=MIRROR,MNTPOINT=/,FSTYPE=ext3

___________________________________________

___________________________________________

2. Job details:

08/19/2015 03:56:12 - Info bpbrm (pid=22359) Backup_Testing is the host to backup data from
08/19/2015 03:56:12 - Info bpbrm (pid=22359) reading file list from client
08/19/2015 03:56:12 - Info bpbrm (pid=22359) starting bpbkar on client
08/19/2015 03:56:12 - Info bpbkar (pid=22366) Backup started
08/19/2015 03:56:12 - Info bpbrm (pid=22359) bptm pid: 22367
08/19/2015 03:56:12 - Info bptm (pid=22367) start
08/19/2015 03:56:13 - Info bptm (pid=22367) using 65536 data buffer size
08/19/2015 03:56:13 - Info bptm (pid=22367) using 30 data buffers
08/19/2015 03:56:13 - Info bptm (pid=22367) start backup
08/19/2015 03:56:13 - Info bptm (pid=22367) Waiting for mount of media id P20277 (copy 1) on server njhp001.
08/19/2015 03:56:14 - Info bpbrm (pid=22359) from client Backup_Testing: TRV - Cannot process path [/usr/openv/netbackup/online_util/fi_cntl/bpfis.fim.Backup_Testing_1439947668.1.0.NBU_DATA.xml]: [No such file or directory]. Skipping
08/19/2015 03:56:15 - Error bptm (pid=22367) media manager terminated during mount of media id P20277, possible media mount timeout
08/19/2015 03:56:17 - Error bptm (pid=22367) media manager terminated by parent process
08/19/2015 03:56:20 - Info bpbkar (pid=0) done. status: 71: none of the files in the file list exist
08/19/2015 06:58:39 - Info nbjm (pid=8953) starting backup job (jobid=1195042) for client Backup_Testing, policy VMBackup_SAN_Test, schedule Full
08/19/2015 06:58:40 - estimated 0 kbytes needed
08/19/2015 06:58:40 - Info nbjm (pid=8953) started backup (backupid=Backup_Testing_1439947719) job for client Backup_Testing, policy VMBackup_SAN_Test, schedule Full on storage unit NJHP001_LTO
08/19/2015 06:58:40 - started process bpbrm (pid=22359)
08/19/2015 06:58:41 - connecting
08/19/2015 06:58:41 - connected; connect time: 0:00:00
08/19/2015 06:58:42 - mounting P20277
08/19/2015 06:58:49 - end writing
none of the files in the file list exist  (71)
___________________________________________________

___________________________________________________

3. Output of listing of the path in file list at Backup media server (njhp001):

njhp001:/usr/openv/netbackup/online_util/fi_cntl # ls -l
total 4516
-rw-rw-rw- 1 root root     284 Aug 18 18:26 Backup_Testing_1439947668_copy1.lock
-rw-r--r-- 1 root root   20332 Aug 13 19:23 bpfis.fim.Backup_Testing_1439519154.1.0.VM_ObjInfoXML.xml
-rw-r--r-- 1 root root   20332 Aug 13 20:28 bpfis.fim.Backup_Testing_1439523060.1.0.VM_ObjInfoXML.xml
-rw-r--r-- 1 root root   20332 Aug 13 20:55 bpfis.fim.Backup_Testing_1439524657.1.0.VM_ObjInfoXML.xml
-rw-r--r-- 1 root root    2301 Aug 18 18:26 bpfis.fim.Backup_Testing_1439947668.1.0
-rw-r--r-- 1 root root    1841 Aug 18 18:26 bpfis.fim.Backup_Testing_1439947668.1.0.NBU_DATA.xml
-rw-r--r-- 1 root root   22568 Aug 18 18:25 bpfis.fim.Backup_Testing_1439947668.1.0.VM_ObjInfoXML.xml
-rw-r--r-- 1 root root     208 Aug 18 18:26 bpfis.fim.Backup_Testing_1439947668.1.0.changeid.xml
-rw-r--r-- 1 root root  548061 Aug 18 16:52 uspnj615.music.wmgis.com.xml
-rw-r--r-- 1 root root  576181 Aug 18 16:52 uspnj615.music.wmgis.comhost.xml
-rw-r--r-- 1 root root  210450 Aug 18 16:51 uspnj622.music.wmgis.com.xml
-rw-r--r-- 1 root root  258515 Aug 18 16:51 uspnj622.music.wmgis.comhost.xml
-rw-r--r-- 1 root root 1284394 Aug 18 16:51 uspnj666.music.wmgis.com.xml
-rw-r--r-- 1 root root 1493756 Aug 18 16:52 uspnj666.music.wmgis.comhost.xml
-rw-r--r-- 1 root root   35062 Aug 18 16:52 vcbnames_uspnj615.music.wmgis.com_Any
-rw-r--r-- 1 root root   13243 Aug 18 16:51 vcbnames_uspnj622.music.wmgis.com_Any
-rw-r--r-- 1 root root   85775 Aug 18 16:52 vcbnames_uspnj666.music.wmgis.com_Any
____________________________________________________

4. bpfis logs are attached.

Let me know if you need any more details.

Thanks !!!

[sdo]

Did you see this:

18:25:28.494 [22338] <2> onlfi_vfms_logf: INF - vmwareLogger: SOAP 1.1 fault: "":ServerFaultCode [no subcode]
"Permission to perform this operation was denied."
Detail: <NoPermissionFault xmlns="urn:vim25" xsi:type="NoPermission"><object type="VirtualMachine">vm-27970</object><privilegeId>VirtualMachine.Config.ChangeTracking</privilegeId></NoPermissionFault>

...maybe check this:

What are the minimum permissions needed to properly backup and restore using vStorage api?

https://support.symantec.com/en_US/article.TECH130493.html

[GulzarShaikhAUS · Accepted solution]

Please check following article along with the one sent by SDO.

After upgrading to 7.6.0.x Snapshot creation may show the following "RegisterExtensionAPI: SYM_VMC_ERROR: SOAP_ERROR"

https://support.symantec.com/en_US/article.TECH130493.html

[N_J]

I have checked that credentials used for vcenter servers to take backup have Admin privledges.

Moreover, backups are successful using nbd but failing using san transport mode.

[Prashant_Kakara]

Hi NJ,

Hope below info will be helpful.

https://support.symantec.com/en_US/article.TECH127089.html

multipathing with SAN transport

NetBackup for VMware on Windows supports multiple SAN paths between the

vSphere ESXi storage and the NetBackup for VMware agent (backup host). Multiple

paths can provide SAN I/O high-availability and higher backup throughput.

With a Linux backup host, NetBackup for VMware is unable to support

multipathing, because of incompatibilities in the following: the Linux operating

system, VMware vStorage APIs for Data Protection, and vendor-specific DMP

solutions.

As a result, NetBackup for VMware cannot support multipathing with a Linux

backup host that is on any of the following platforms:

■ NetBackup 52x0 Appliance

■ NetBackup for VMware on SLES

■ NetBackup for VMware on RHEL

Support for multipathing with Linux backup hosts may be included in a future

release.

Note the following:

■ This issue does not affect NetBackup support forVMware’s Native Multipathing

(NMP). NMP is multipathing between the ESXi host and storage.

■ This issue does not affect NetBackup for VMware on Windows backup hosts.

The Windows OS has integrated multipathing support. The following Microsoft

guide contains more information:

[N_J]

Hi Prashant

If i understand you correctly, VM backup using SAN transport mode would not work on SUSE Linux as backup media server. However i dont think this would be the case as I have checked the same in SORT.

I would reiterate my situation again, below are the 2 zones that have been created at switch end.

Zone1 - ESXi host : Storage Array(EMC VNX) (Zone was already existing prior to our netbackup configuration)

Zone2 - SUSE linux backup media server : Storage Array (EMC VNX)

LUN on which the VM reside have been made visible to the backup media server (unmounted & online) what i could extract from the error logs is that snapshot is not visible to the media server.

I am not sure whether multipathing thing would affect the above setup as it is a simple configuration.

[sdo]

For your versions, multipathing of LUNs to the backup host is not supported.  My advice for next step(s) is to change your storage presentation so that the LUNs are not multi-pathed to the backup host, and then try the SAN transport backup method again.