VMware credential validation failed (-999)

[faceless]

Hello,

We have an issue during the validation of credentials for VMware during our test lab. This is a Validation failed -999 when adding the Virtual Machine Server (vCenter) in the credentials (we already add the vCenter to the VMware backup host in the master host properties).

• ESX version: 4.0
• vCenter OS: win2003
• vCenter NBU version: 7.0
• NBU master server version: 7.0 (under Linux)
• vCenter and master are under the same ESX (only for this testlab)

Connections between servers are ok, credentials are correct (checked in vSphere), cleaning of old configuration was made in GUI + nbemmcmd delete host command.

Does anyone have this issue? If you need more information, feel free to ask for.

Thanks in advance,

D.

[RiaanBadenhorst]

Hi,

See if there are any clues in

<install_path>\Veritas\NetBackup\logs\bpvmutil

Also, after you're added the vCenter/ESX Host, try and close the GUI and re-open. I got stuck once with a 195 error adding the credentials, closed and opened the admin console, error dissappeared....

[faceless]

Hi,

Thanks for your answer. Unfortunately, there is nothing under bpVMutil. The nbproxy log show a connection reset by peer:

13:10:17.700 [16678] <2> dblibFacadeImpl::getAllVMs(): ConnectToBPCD returned:0(dblibFacadeImpl.cpp:3027)

13:10:17.700 [16678] <2> bpcr_get_version_rqst: bpcd version: 07000000

13:10:17.701 [16678] <2> get_short: (1) cannot read (byte 1) from network: Connection reset by peer (104)

13:10:17.701 [16678] <2> dblibFacadeImpl::getAllVMs(): bpcr_get_virtual_names_rqst returned:-3(dblibFacadeImpl.cpp:3039)

13:10:17.701 [16678] <2> put_short: (10) network write() error: Broken pipe (32); socket = 16

13:10:17.701 [16678] <2> bpcr_disconnect_rqst: bpcr protocol error - couldn't send request type

13:10:17.701 [16678] <2> dblibFacadeImpl::getAllVMs(): bpcr_disconnect_rqst returns -1(dblibFacadeImpl.cpp:3045)

13:10:17.701 [16678] <2> dblibFacadeImpl::getVMVirtualServerInfoSeq(): getAllVMs call failed. Return code:-3(dblibFacadeImpl.cpp:3182)

But all servers communicate correctly (bptestbpcd or bpclntcmd).

[RiaanBadenhorst]

Try running this and see what it produces

bpvmutil 0 NOCACHE 0

[Tim_Hansen]

is your vCenter server sitting in another network segment (like a DMZ)? Can you access the server over port 443?

[faceless]

Hi,

@Tim; The vCenter is in the same network and access to the server over port 443 is ok.

@Riaan; What's this command?

The credentials are ok with the ESX... But no browsing, issue with a popup (see attached file). When manually adding a client, backup fail with status 71 (was just a test because credentials were ok). Furthermore, we had a new interesting log from bpcd:

17:06:11.485 [4245] <2> bpcd main: accept sock = 9
17:06:11.486 [25217] <2> process_requests: offset to GMT -3600
17:06:11.487 [25217] <2> logconnections: BPCD ACCEPT FROM 192.168.19.120.37086 TO 192.168.19.86.13724
17:06:11.487 [25217] <2> process_requests: setup_sockopts complete
17:06:11.487 [25217] <2> bpcd peer_hostname: Connection from host poc_master (192.168.19.120) port 37086
17:06:11.487 [25217] <2> bpcd valid_server: comparing poc_master and poc_master
17:06:11.491 [25217] <4> bpcd valid_server: hostname comparison succeeded
17:06:11.491 [25217] <2> process_requests: output socket port number = 1
17:06:11.565 [25217] <2> process_requests: Duplicated vnetd socket on stderr
17:06:11.565 [25217] <2> process_requests: <---- NetBackup 7.0 0 ------------initiated
17:06:11.565 [25217] <2> process_requests: VERBOSE = 0
17:06:11.565 [25217] <2> process_requests: Not using VxSS authentication with poc_master
17:06:11.606 [25217] <2> process_requests: BPCD_GET_VERSION_RQST
17:06:11.606 [25217] <16> process_requests: bad token 95

Thanks in advance.

[Anonymous]

the credentials you are using are for a local account on the vcenter server, not a domain account.? Make it a member of the local admin group also for testing.

[faceless]

Hi Stuart,

Thanks for your answer. Same result with local and domain admin.

Check on the master that the hosts file is the first choice in nsswitch.conf is done.

[Tim_Hansen]

can you show us the output of nbemmcmd -listhosts?

[faceless]

Hello,

At first an upgrade from 7.0 to 7.0.1 has been made on the master server. After this upgrade, credentials with the ESX + browsing are ok. That's a good point.

Next step is to upgrade the backup host (in progress), because credentials with it still doesn't work.

- Output nbemmcmd -listhosts: NBEMMCMD, Version:7.0
The following hosts were found:
server          poc_master
master          poc_master
ndmp            poc_master
virtual_machine vmware-mgt #vCenter, backup host
virtual_machine 3s-esx1 #ESX
Command completed successfully.