Sharepoint 2007 GRT backup failed status code 72 the client type is incorrect in the configuraton database

[DavidE31]

Hello,

our NBU environment is made of master and media servers with NBU 7.5.0.7 on Windows 2008
we backup a sharepoint 2007 farm made of Windows 2003 R2 enterprise x64 servers
with NBU 7.5.0.7 on all servers :
fr0-ccsidx-p01 index
fr0-ccs-v01 and fr0-ccs-v02 frontend
fr0-ccssql-v01 fr0-ccssql-v02 and fr0-ccssql-v03 backend

ccssql-v01 and ccssql-v02 are Microsoft clustered.The first node runs SQL Instance named CONT and the second one runs SQL Instance named SEAR
The third one is a passive node
Netbackup is not running as a cluster on these nodes. the agent is stand-alone installed on each node.
All prereq including NFS enabled are ok for GRT backups
We have issues with backup some webapplications with GRT enabled on the SEAR instance.Backups on the other instance are ok.
Failed backups end with status code 72 the client type is incorrect in the configuraton database
backup and file-level restores for contents of the CONT instance have been tested successfully on one content

 

bpfis on 2nd node backend server :

08:30:15.544 [7208.4580] <4> bpfis: INF - Preparing freeze of Microsoft SharePoint Resources:\Windows SharePoint Services Web Application\CCS-VAL\Content-DB 11 (FR0-CCSQLVSEAR/VM370SEAR/Portal_Site_Content_102) using snapshot method VSS_Writer.
08:30:15.544 [7208.4580] <4> bpfis: INF - Created mount point D:\Program Files\Veritas\NetBackup\temp\_vrts_frzn_img_Microsoft SharePoint Resources_Windows SharePoint Services Web Application_CCS-VAL_Content-DB 11 (FR0-CCSQLVSEAR_VM370SEAR_Portal_Site_7208_1
08:30:15.685 [7208.4580] <4> bpfis: INF - Deleted mount point D:\Program Files\Veritas\NetBackup\temp\_vrts_frzn_img_Microsoft SharePoint Resources_Windows SharePoint Services Web Application_CCS-VAL_Content-DB 11 (FR0-CCSQLVSEAR_VM370SEAR_Portal_Site_7208_1
08:30:15.685 [7208.4580] <8> bpfis: WRN - VfMS error 10; see following messages:
08:30:15.685 [7208.4580] <8> bpfis: WRN - Non-fatal method error was reported
08:30:15.685 [7208.4580] <8> bpfis: WRN - vfm_freeze: method: VSS_Writer, type: FIM, function: VSS_Writer_freeze
08:30:15.685 [7208.4580] <8> bpfis: WRN - VfMS method error 8; see following message:
08:30:15.685 [7208.4580] <8> bpfis: WRN - config =prov_type=0,snap_attr=0,max_snapshots=128,APP_TYPE=FS,BACKUP_TIME=1391671793,POLICY_NAME=VAL_2007_Sharepoint_GRT_03,NBU_CLIENT=FR0-CCSQLVSEAR,NBU_MASTER=fr0-sfsnbma01,SCHED_NAME=Full,SCHED_TYPE=FULL,POLICY_TYPE=8,PFI_BACKUP=0,NBU_CATALOG=0,GRAN_BACKUP=1,VIRT_BACKUP=0,SPSV2_FE_CLIENT=fr0-ccsidx-v01,id=FR0-CCSQLVSEAR_1391671782
08:30:15.826 [7208.4580] <16> bpfis: FTL - snapshot preparation failed - Appears to be invalid client type., status 72
08:30:15.826 [7208.4580] <16> bpfis: FTL - snapshot preparation failed - Appears to be invalid client type., status 72
08:30:15.826 [7208.4580] <16> bpfis: FTL - snapshot preparation failed - Appears to be invalid client type., status 72
08:30:15.826 [7208.4580] <16> bpfis: FTL - snapshot preparation failed - Appears to be invalid client type., status 72
08:30:15.826 [7208.4580] <4> bpfis: INF - Thawing Microsoft SharePoint Resources:\Windows SharePoint Services Web Application\CCS-VAL\Content-DB 9 (FR0-CCSQLVSEAR/VM370SEAR/Portal_Site_Content_104) using snapshot method VSS_Writer.
08:30:15.826 [7208.4580] <4> bpfis: INF - do_thaw return value: 0
08:30:15.826 [7208.4580] <4> bpfis: INF - Thawing Microsoft SharePoint Resources:\Windows SharePoint Services Web Application\CCS-VAL\Content-DB 10 (FR0-CCSQLVSEAR/VM370SEAR/Portal_Site_Content_103) using snapshot method VSS_Writer.
08:30:15.826 [7208.4580] <4> bpfis: INF - do_thaw return value: 0
08:30:15.826 [7208.4580] <4> bpfis: INF - Thawing Microsoft SharePoint Resources:\Windows SharePoint Services Web Application\CCS-VAL\Content-DB 11 (FR0-CCSQLVSEAR/VM370SEAR/Portal_Site_Content_102) using snapshot method VSS_Writer.
08:30:15.826 [7208.4580] <4> bpfis: INF - do_thaw return value: 0
08:30:15.826 [7208.4580] <4> bpfis: INF - Thawing Microsoft SharePoint Resources:\Windows SharePoint Services Web Application\CCS-VAL\Content-DB 12 (FR0-CCSQLVSEAR/VM370SEAR/Portal_Site_Content_101) using snapshot method VSS_Writer.
08:30:15.826 [7208.4580] <4> bpfis: INF - do_thaw return value: 0
08:30:15.826 [7208.4580] <4> bpfis: INF - EXIT STATUS 72: the client type is incorrect in the configuration database
08:30:17.966 [7208.4580] <4> bpfis: Starting keep alive thread.
08:30:19.966 [7208.4580] <4> try_vss_unlockmutex: VSS Snapshot Mutex Unlock
08:30:22.060 [5092.6372] <2> logparams: D:\Program Files\Veritas\NetBackup\bin\bpfis.exe delete -nbu -id FR0-CCSQLVSEAR_1391671782 -bpstart_to 300 -bpend_to 300 -clnt FR0-CCSQLVSEAR -pt 8 -st FULL -status 72 -S fr0-sfsnbma01 -jobid 29936 -copy 1
08:30:22.060 [5092.6372] <4> bpfis: Starting keep alive thread.
08:30:22.060 [5092.6372] <4> bpfis: Acquiring snapshot lock:retry count [0]
08:30:22.060 [5092.6372] <2> getFileName:  FileName is [D:\Program Files\Veritas\NetBackup\online_util\fi_cntl\FR0-CCSQLVSEAR_1391671782_copy1.lock]
08:30:22.060 [5092.6372] <2> getFileName:  FileName is [D:\Program Files\Veritas\NetBackup\online_util\fi_cntl\FR0-CCSQLVSEAR_1391671782_copy1.lock]

A case is opened with Symantec waiting for analyzis

Hope you can help ...

Thanks

EDIT :

Policy Name:       VAL_2007_Sharepoint_GRT_03

  Policy Type:         MS-SharePoint
  Active:              no
  Effective date:      07/15/2013 17:09:42
  Mult. Data Streams:  no
  Client Encrypt:      no
  Checkpoint:          no
  Policy Priority:     1000
  Max Jobs/Policy:     Unlimited
  Disaster Recovery:   0
  Collect BMR info:    no
  Residence:           STU_MSDP_ME01
  Volume Pool:         NetBackup
  Server Group:        *ANY*
  Keyword:             (none specified)
  Data Classification:       -
  Residence is Storage Lifecycle Policy:    no
  Application Discovery:      no
  Discovery Lifetime:      28800 seconds
ASC Application and attributes: (none defined)

  Granular Restore Info:  yes
  Ignore Client Direct:  yes
Enable Metadata Indexing:  no
Index server name:  NULL
  Use Accelerator:  no
  HW/OS/Client:  Windows-x64   Windows2003   fr0-ccsidx-v01

  Include:  Microsoft SharePoint Resources:\Windows SharePoint Services Web Application\CCS-VAL\Content-DB 9 (FR0-CCSQLVSEAR/VM3
70SEAR/Portal_Site_Content_104)
            Microsoft SharePoint Resources:\Windows SharePoint Services Web Application\CCS-VAL\Content-DB 10 (FR0-CCSQLVSEAR/VM
370SEAR/Portal_Site_Content_103)
            Microsoft SharePoint Resources:\Windows SharePoint Services Web Application\CCS-VAL\Content-DB 11 (FR0-CCSQLVSEAR/VM
370SEAR/Portal_Site_Content_102)
            Microsoft SharePoint Resources:\Windows SharePoint Services Web Application\CCS-VAL\Content-DB 12 (FR0-CCSQLVSEAR/VM
370SEAR/Portal_Site_Content_101)

  Schedule:              Full
    Type:                Automatic Backup
    Frequency:           every 7 days
    Maximum MPX:         1
    Synthetic:           0
    Checksum Change Detection: 0
    PFI Recovery:        0
    Retention Level:     3 (5 weeks)
    Number Copies:       1
    Fail on Error:       0
    Residence:           (specific storage unit not required)
    Volume Pool:         (same as policy volume pool)
    Server Group:        (same as specified for policy)
    Residence is Storage Lifecycle Policy:         0
    Schedule indexing:     0
    Daily Windows:
          Saturday   02:00:00  -->  Saturday   08:00:00

[DavidE31]

Policy :

Policy Name:       VAL_2007_Sharepoint_GRT_03

  Policy Type:         MS-SharePoint
  Active:              no
  Effective date:      07/15/2013 17:09:42
  Mult. Data Streams:  no
  Client Encrypt:      no
  Checkpoint:          no
  Policy Priority:     1000
  Max Jobs/Policy:     Unlimited
  Disaster Recovery:   0
  Collect BMR info:    no
  Residence:           STU_MSDP_ME01
  Volume Pool:         NetBackup
  Server Group:        *ANY*
  Keyword:             (none specified)
  Data Classification:       -
  Residence is Storage Lifecycle Policy:    no
  Application Discovery:      no
  Discovery Lifetime:      28800 seconds
ASC Application and attributes: (none defined)

  Granular Restore Info:  yes
  Ignore Client Direct:  yes
Enable Metadata Indexing:  no
Index server name:  NULL
  Use Accelerator:  no
  HW/OS/Client:  Windows-x64   Windows2003   fr0-ccsidx-v01

  Include:  Microsoft SharePoint Resources:\Windows SharePoint Services Web Application\CCS-VAL\Content-DB 9 (FR0-CCSQLVSEAR/VM3
70SEAR/Portal_Site_Content_104)
            Microsoft SharePoint Resources:\Windows SharePoint Services Web Application\CCS-VAL\Content-DB 10 (FR0-CCSQLVSEAR/VM
370SEAR/Portal_Site_Content_103)
            Microsoft SharePoint Resources:\Windows SharePoint Services Web Application\CCS-VAL\Content-DB 11 (FR0-CCSQLVSEAR/VM
370SEAR/Portal_Site_Content_102)
            Microsoft SharePoint Resources:\Windows SharePoint Services Web Application\CCS-VAL\Content-DB 12 (FR0-CCSQLVSEAR/VM
370SEAR/Portal_Site_Content_101)

  Schedule:              Full
    Type:                Automatic Backup
    Frequency:           every 7 days
    Maximum MPX:         1
    Synthetic:           0
    Checksum Change Detection: 0
    PFI Recovery:        0
    Retention Level:     3 (5 weeks)
    Number Copies:       1
    Fail on Error:       0
    Residence:           (specific storage unit not required)
    Volume Pool:         (same as policy volume pool)
    Server Group:        (same as specified for policy)
    Residence is Storage Lifecycle Policy:         0
    Schedule indexing:     0
    Daily Windows:
          Saturday   02:00:00  -->  Saturday   08:00:00

[sri_vani]

Please verify this Technote

http://www.symantec.com/business/support/index?page=content&id=TECH202327

[DavidE31]

Thank you Sri

The detailed status code 72 in this technote is not exactly the same one I get when I try to backup contents on the SEAR instance

However, what I've noticed is that for both CONT and SEAR instances, when backup jobs run, one backup job is related to fr0-ccsidx-p01 (the index server), and the other backup job is either related to FR0-CCSQLVCONTE (which is fr0-ccssql-v01) when backing up CONT instance or related to FR0-CCSQLVSEAR (which is fr0-ccssql-v02) when backing up SEAR instance.

As the client added to the policy is fr0-ccsidx-v01, how would I have to add FR0-CCSQLVCONTE and FR0-CCSQLVSEAR and edit these clients properties to specify the Sharepoint account ?

This sharepoint account is already set for all servers of the farm, and is correct as far as I can see

[Marianne]

 Granular Restore Info:  yes

HW/OS/Client:  Windows-x64   Windows2003   fr0-ccsidx-v01

W2003 is unfortunately not supported for GRT backups.

See Microsoft SharePoint - Supported Configurations in NetBackup 7 Application/Database Agent (CL):    http://www.symantec.com/docs/TECH126904

4. GRT is not supported on Windows 2003

[DavidE31]

Marianne,

Our Sharepoint servers are Windows 2003 R2 servers that as far as I understand from the compatibility guide are supported :

"SharePoint Granular Recovery

All of the configurations noted below are supported for SharePoint Server Granular Recovery. For Information on the media server platforms that are supported for

Granular Recovery Technology (GRT) reference the NetBackup Enterprise Server and Server 7.x OS Software Compatibility List."

Pages 23 and 24, for Sharepoint 2007 and Windows 2003 R2 servers, there is no note that tells GRT is not supported (seems to be supported on R2, not on W2003)

I can make some restores (tried again this morning with documents and lists) on one instance, but I can't figure out why on the other instance GRT restore does not work. Properties of both instances were compared to, there is no difference between them