Error 6 Transport status 23

Arnold1989 · ‎03-16-2021

Please i have this error about policy who have many VMs and the job succeed with some vms and failed with others VMs who are included in the same Vcenter and share the same LUN datastore provided from SAN.

Need your help about this issuer

X2 · ‎03-16-2021

@Arnold1989 You need to give details of your environment. E.g. NetBackup version, master isappliance or custom built host (OS version), backup host version, ESXi version. Are you using SAN connectivity? or just network?

If some VMs are being backed up successfully, I'm assuming that network connectivity between NetBackup and vCenter is working fine.

Have you checked this KB? If it does not help, enable vxms logs and try backup again and post back with results and logs.

Also, when troubleshooting VMware VIP backups, it is a good idea to use just a single transport mode (the one which you expect to work normally). This way you will know if that mode works or not.

Arnold1989 · ‎03-17-2021

Hello @X2, thank you for your feeback

Find all information about environment :

- NetBackup version : 8.0

- Master is custom built host (OS version : Red Hat Enterprise Linux Server release 6.4 (Santiago) )

- backup host version : Netbackup Media 8.0

- ESXi version : 6.0.

- Are you using SAN connectivity? or just network? : All LUN datastore on Vcenter are provided via SAN but VMWare Backup Host (Media) is connected to Vcenter via ip network and the media is connected to DataDomain(storage unit) via FC(SAN).

Let me enable vxms logs and try backup ans come to you with results and logs

Laurence_Merry · ‎03-17-2021

What transport method is being used? NBD or SAN?

Did you follow the link that was provided in another post?

Arnold1989 · ‎03-17-2021

Hello @Laurence_Merry the transport mode is NBD.

I have follow this link but the directory /tmp/vmware-root don't contain file in Media Server

Regards

Arnold1989 · ‎03-17-2021

Hello @X2

Find attach the vxms log file as requested.

Regards

X2 · ‎03-17-2021

@Arnold1989 The log shows failure to connect to guest using either SAN, nbd, hotadd or nbdssl.

Can you try again using only nbd (check on nbd in VIP VMware tab) and vxms logs at verbose=3?

Arnold1989 · ‎03-17-2021

Hello @X2

I have the same error after i put only NBD mode transport.

Regards

X2 · ‎03-17-2021

If your NBD transport mode is not working, you need to investigate communication between the backup host and the VMware environment.

Also, use information on the topic would be:

when did this issue occur the first time?
what changed at that time or just before it to have caused it?
are your other VIP backups working normally?

If you (or your network or information security team) can answer the above, it might indicate where to look at for resolution of the issue.

Marianne · ‎03-17-2021

@Arnold1989

The vxms logging level is unfortunately too low.
Please increase logging level as suggested by @X2 and post the log after the next failure.

If backups are working fine for other vm's on the same datastore, we can rule out connectivity issues.
Have you tried to find out what is 'different' about these failing vm's?

Did you configure Resource Limits for VMware backups?
If too many simultaneous backups are taken from the same datastore, it could cause performance or even comms timeout.
Maybe a good idea to monitor vCenter logs while the backups are running.

Handy NetBackup Links

Arnold1989 · ‎03-18-2021

Hello @Marianne

Find attach the screenshot about configuration Ressource Limit.

The configuration about vxms_verbose = "3" as in the screenshot

Marianne · ‎03-18-2021

Level 3 logging might be too low.

See this doc:

https://www.veritas.com/support/en_US/article.100022695

For possible VDDK issues:
VXMS_VERBOSE = 5

For Mapping issues during the VMware Backup, use:
VXMS_VERBOSE = 8

Note: VXMS_VERBOSE = 8 will slow down backups and restore operations.

Handy NetBackup Links

Arnold1989 · ‎03-18-2021

Hello @Marianne

I have changed value of VxMS to 8 and find attach the file logs after test manual backup.

Regards

Arnold1989 · ‎03-18-2021

Another File attach

X2 · ‎03-18-2021

I see connectivity issues, is port 902 open..... resolve these first and try again.

03/18/2021 10:58:59 : g_vixInterfaceLogger:libvix.cpp:1800 <DEBUG> : [VFM_ESINFO] Cnx_Connect: Error message: Failed to connect to server esxi-ess-ndg-svr04.adcm.orangecm:902

   03/18/2021 10:58:59 : g_vixInterfaceLogger:libvix.cpp:1804 <DEBUG> : [VFM_ESWARN] [NFC ERROR] NfcNewAuthdConnectionEx: Failed to connect to peer. Error: Failed to connect to server esxi-ess-ndg-svr04.adcm.orangecm:902

   03/18/2021 10:58:59 : g_vixInterfaceLogger:libvix.cpp:1800 <DEBUG> : [VFM_ESINFO] NBD_ClientOpen: Couldn't connect to esxi-ess-ndg-svr04.adcm.orangecm:902 Failed to connect to server esxi-ess-ndg-svr04.adcm.orangecm:902

.....
.....

03/18/2021 10:58:59 : g_vixInterfaceLogger:libvix.cpp:1800 <DEBUG> : [VFM_ESINFO] VixDiskLib: Unable to locate appropriate transport mode to open disk. Error 13 (You do not have access rights to this file) at 4570.

Marianne · ‎03-18-2021

I saw the same as @X2 :

03/18/2021 11:22:07 : g_vixInterfaceLogger:libvix.cpp:1800 <DEBUG> : [VFM_ESINFO] VixDiskLib: VixDiskLib_Open: Cannot open disk [vmax_250_Exchange_dst_01] NDBSVR-DC01/NDBSVR-DC01.vmdk. Error 13 (You do not have access rights to this file) at 4718.

03/18/2021 11:22:07 : vdOpen:VixInterface.cpp:440 <DEBUG> : Done with Open(): 0
03/18/2021 11:22:07 : vdOpen:VixInterface.cpp:464 <WARN> : Open() error: 13
03/18/2021 11:22:07 : openLeafSnapshotDisks:VixGuest.cpp:468 <DEBUG> : vdOpen() error = 13. Calling closeLeafSnapshotDisks()
03/18/2021 11:22:07 : log:Error.cpp:249 <WARN> : Error: 0x00000017 occured in file ../VixGuest.cpp, at line 605
03/18/2021 11:22:07 : log:Error.cpp:249 <WARN> : Error: 0x00000017 occured in file ../VixGuest.cpp, at line 605
03/18/2021 11:22:07 : vixMapObjCtl:VixCoordinator.cpp:964 <WARN> : Returning: 23
03/18/2021 11:22:07 : hv_vmware_map_objctl:libvix.cpp:1168 <WARN> : Returning: 23

You need to read NBU documentation about rights needed for backups and ensure that the user account added to NBU has all of the rights that are required.

Handy NetBackup Links

Arnold1989 · ‎03-25-2021

Hello @Marianne @X2

sorry for my late reply I was a little unwell, but the tracks indicated were good and I was able to make backups of these VMs. The problem arose in the communication between the media and the ESXi, when I change to the media that communicates with the ESXi, the backups are performed. I have one last question: in the principle of operation of Netbackup, the media or the backup hosts must absolutely communicate with the ESXis as long as I integrate the Vcenter in my configurations?