cancel
Showing results for 
Search instead for 
Did you mean: 

HELP!!! My PureDisk Diskpool keeps going down

Merv
Level 6
Partner

I am using netbackup 7.0 deduplication storage server . Have 1 master (also media) and 1 media.

I rebooted the master server (after entering some license) and after that the diskpool issue started happening. At first i thought it was a licensing issue as I just entered in some license keys. However have reverted the changes but the issue persists.

 

 

Disk Pool Name      : DSK_POOL
Disk Type           : PureDisk
Disk Volume Name    : PureDiskVolume
Disk Media ID       : @aaaab
Total Capacity (GB) : 16381.31
Free Space (GB)     : 5721.40
Use%                : 65
Status              : DOWN
Flag                : ReadOnWrite
Flag                : AdminUp
Flag                : InternalDown
Num Read Mounts     : 0
Num Write Mounts    : 1
Cur Read Streams    : 0
Cur Write Streams   : 0
 
bperror -disk keeps giving this error: 
Task sessin on start request on server PureDisk:my_media_server on my_media_server got an unexpected
error.
 
I try to run nbdevconfig -changestate to UP and it just does not work. Have tried rebooting,restarting services,still down. As fas as i can tell there is no issues on the disk. I have another media server connected to the same san with no issues. backup fails immediately with storage unit unavailable errors. Backing up to tape using the same media server is ok. The other thing is my media server.
 
Am on hold on the support live queue for like an hour.....if anyone has any troubleshooting tips please help .thanks
8 REPLIES 8

AAlmroth
Level 6
Partner Accredited

First, is there enough disk space on /tmp? You don't mention OS, but postgresql will not start unless it can store its temp files.

Look in <install path>/logs for your PDDE. Does spoold, spad log anything interesting?

What does the general Problems report say?

If Windows, check Windows events. Anti-virus, firewalls?

Changes made to running config, but not made permanent prior reboot?

Many possible sources of errors...

/A

Merv
Level 6
Partner

We fond that that this could be licensing related. Am confirming with support.

Sachin_Pathare
Level 4
Employee Certified

1] Make sure all the services related to MSDP are started in addition to other NBU services:
a] PostgreSQL Server 8.3
b] NetBackup Deduplication Engine
c] NetBackup Deduplication Manager

2] To check the communication between the media server and MSDP:
<install_drive>\Program files\Veritas\Netbackup\bin\admincmd\bpstsinfo -si -sp PureDisk: -sn <MSDP_MEDIA_SERVER_NAME>
e.g: bpstsinfo -si -sp PureDisk: -sn NBU-MSDP-SERVER
This should give an o/p like:
Server Info:
        Server Name: PureDisk:NBU-MSDP-SERVER
        Supported Stream Formats:
        [
        ]
        Server Flags: (STS_SRV_ASYNC | STS_SRV_IMAGELIST | STS_SRV_CRED | STS_SR
V_CONRW)
        Maximum Connections: 0
        Current Connections: 1
        Supported Interfaces:
        [
        ]
        Supported Credentials:
        [
        ]
 
3] Try the RESET option:
Command: nbdevconfig -changestate -stype PureDisk -dp <Disk Pool name> -dv <disk volume name> -state RESET
-state UP | DOWN | RESET
Selects the state of the disk pool or disk volume. Specify UP to up the disk pool or disk volume and DOWN to down the disk pool or disk volume.
The RESET option does the following:
Sets the internal state to UP (both disk volume and disk pool)
Sets committed_space to ZERO (disk volume only)
Sets the precommitted space to ZERO (disk volume only)
 
4] Any events in the event viewer related to MSDP

Merv
Level 6
Partner

Hi Sachin,

 

I have a case logged with support Case 600-600-908 .The thing is the very next day my disk pool came up on it's own.

They have identified this as NOT license issue but related to http://www.symantec.com/business/support/index?page=content&id=TECH130869

"After Startup of NetBackup on a server with Media Server De-Duplication Pool (MSDP) configured the PureDisk Volume will be down until spoold's Connection Manager has completed it's startup - this can take an extended amount of time."

As far as I can tell there is no fix. I'm trying to establish the following:

 

  1. What is the estimated amount of time for the PureDisk volume to come up after a restart of netbackup services?
  2. If this is based on the number of Tlogs outstanding how do we reduce or managed this growth in tlogs?
  3.  Is there any tuning configurations on change in configuration of the Puredisk Volume size on number of clients/jobs/policy which will affect this?
  4. Any workaround or EBB planned to reduce the timings for this? Based on our estimate the timing was about 17 hours to get the puredisk volume up the last time.

I'm going through my spoold logs to check on this throughly. There is a backline /engr person  working with support. They have also told me to apply 7.01 to fix http://www.symantec.com/business/support/index?page=content&id=TECH128694

Thus we are waiting on confirmation for the next steps.

 

Merv

djlaube
Level 3
Partner

Sounds like an issue addressed in ET2073963.. have you upgraded to v7.0.1 yet? I believe they have rolled the EEB/ET above into v7.0.1..

Merv
Level 6
Partner

Have checked on that Etrack with support and they mentioned thats does not apply to my scenario..i noticed my msdp is unusually slow with processing those tlogs in the queue folder. also thinga like  garbage collection take very long as compared to the other MSDP server

Merv
Level 6
Partner

Hi All,

 

Anybody good with reading spoold logs? it's been 4 mths and this issue is still bugging us. Support are saying it's a disk i/o issue however iostats are looking normal..my controllers are not busy and there is an avg of only 4-6MB of reads/writes during the time the disk pool is down. I do see the below errors in spoold though,(have replaced the servername by MSDP-Server and IP).

 

Anyone know what "ERR25099: Message transmission failed: sent -1 instead of 36 bytes (broken pipe)" means or what "INFO [46]: (unknown) Task 29 [thread 46] for 10.x.x.x:37532 failed with unknown error." what task29 is referring to?

My disk spool remains down and I got error 213 during backups. After manually running a nbdevconfig changestate to "UP" was I able to proceed with backup. So without manual intervention the diskpool does not come up.

 

My other netbackup services are fine and I can run backups to tape as well as my other MSDP(windows ) is ok - can run backups to the puredisk pool without issue

I also get alot of error 11 when running a truss command against the spad process

SPOOLD log snippets:

Stopped NBU services

 

 

January 27 15:57:37 INFO [1]: === Symantec PureDisk Content Router ===
 
January 27 15:57:44 WARNING [1]: 25036: Connection to crdb was severed (connection reset by peer). Attempting to reconnect to MSDP-server:10085
January 27 15:57:44 ERR [1]: 25036: Connection reset to crdb at MSDP-server:10085 failed (FATAL:  the database system is shutting down
 
1 hour later
 
January 27 16:55:32 ERRJanuary 27 16:55:32  [15]: ERR25099: Message transmission failed: sent -1 instead of 36 bytes (broken pipe)
[22]: 25099: Message transmission failed: sent -1 instead of 36 bytes (broken pipe)
January 27 16:55:32 ERR [11]: 25099: Message transmission failed: sent -1 instead of 36 bytes (broken pipe)
January 27 16:55:32 January 27 16:55:32 January 27 16:55:32 ERRJanuary 27 16:55:32 ERRJanuary 27 16:55:32 ERR [10]: INFOJanuary 27 16:55:32 January 27 16:55:32  [20]: INFO [29]: 25099: Message transmission failed: sent -1 instead of 36 bytes (broken pipe)
[13]: ERRERR25099: Message transmission failed: sent -1 instead of 36 bytes (broken pipe)
[12]: 25099: Message transmission failed: sent -1 instead of 36 bytes (broken pipe)
January 27 16:55:32 Remote is using libcr Version 6.6.0.35883, Protocol Version 6.6 running on SunOS-sun4. Agent crcontrol requesting access for DataSelection ID 1
[32]: January 27 16:55:32  [21]: January 27 16:55:32 January 27 16:55:32 Remote is using libcr Version 6.6.0.35883, Protocol Version 6.6 running on SunOS-sun4. Agent nbrmms requesting access for DataSelection ID 2
January 27 16:55:32 ERR25099: Message transmission failed: sent -1 instead of 36 bytes (broken pipe)
January 27 16:55:32 ERR25099: Message transmission failed: sent -1 instead of 36 bytes (broken pipe)
 
January 27 16:55:32 INFO [46]: (unknown) Task 29 [thread 46] for 10.x.x.x:37532 failed with unknown error.
January 27 16:55:32 INFO [35]: (unknown) Task 24 [thread 35] for 10.x.x.x:37219 failed with unknown error.
January 27 16:55:32 INFO [47]: (unknown) Task 28 [thread 47] for 10.x.x.x:37545 failed with unknown error.
January 27 16:55:32 INFO [42]: (unknown) Task 32 [thread 42] for 10.x.x.x:37437 failed with unknown error.
January 27 16:55:32 INFO [44]: (unknown) Task 31 [thread 44] for 10.x.x.x:37463 failed with unknown error.
January 27 16:55:32 INFO [31]: (unknown) Task 20 [thread 31] for 10.x.x.x:37093 failed with unknown error.
January 27 16:55:32 INFO [33]: (unknown) Task 22 [thread 33] for 10.x.x.x:37122 failed with unknown error.
January 27 16:55:32 INFO [40]: (unknown) Task 34 [thread 40] for 10.x.x.x:37396 failed with unknown error.
January 27 16:55:32 INFO [27]: (unknown) Task 14 [thread 27] for 10.x.x.x:37005 failed with unknown error.
January 27 16:55:32 INFO [34]: (unknown) Task 23 [thread 34] for 10.x.x.x:37183 failed with unknown error.
January 27 16:55:32 INFO [48]: (unknown) Task 27 [thread 48] for 10.x.x.x:37564 failed with unknown error.
January 27 16:55:32 INFO [19]: (unknown) Task 39 [thread 19] for 10.x.x.x:36875 failed with unknown error.
January 27 16:55:32 INFO [43]: (unknown) Task 38 [thread 43] for 10.x.x.x:37450 failed with unknown error.
January 27 16:55:32 INFO [39]: (unknown) Task 35 [thread 39] for 10.x.x.x:37357 failed with unknown error.
January 27 16:55:32 INFO [37]: (unknown) Task 37 [thread 37] for 10.x.x.x:37265 failed with unknown error.
January 27 16:55:32 INFO [16]: (unknown) Task 4 [thread 16] for 10.x.x.x:36836 failed with unknown error.
January 27 16:55:32 INFO [26]: (unknown) Task 15 [thread 26] for 10.x.x.x:36992 failed with unknown error.
January 27 16:55:32 INFO [38]: (unknown) Task 36 [thread 38] for 10.x.x.x:37326 failed with unknown error.
January 27 16:55:32 INFO [25]: (unknown) Task 16 [thread 25] for 10.x.x.x:36982 failed with unknown error.
January 27 16:55:32 INFO [45]: (unknown) Task 30 [thread 45] for 10.x.x.x:37476 failed with unknown error.
January 27 16:55:32 INFO [23]: (unknown) Task 10 [thread 23] for 10.x.x.x:36955 failed with unknown error.
January 27 16:55:32 INFO [18]: (unknown) Task 13 [thread 18] for 10.x.x.x:36868 failed with unknown error.
January 27 16:55:32 INFO [30]: (unknown) Task 19 [thread 30] for 10.x.x.x:37080 failed with unknown error.
January 27 16:55:32 INFO [13]: (unknown) Task 12 [thread 13] for 127.0.0.1:36803 failed with unknown error.
January 27 16:55:32 INFO [28]: (unknown) Task 17 [thread 28] for 10.x.x.x:37012 failed with unknown error.
January 27 16:55:32 INFO [17]: (unknown) Task 3 [thread 17] for 10.x.x.x:36847 failed with unknown error.
January 27 16:55:32 INFO [14]: (unknown) Task 6 [thread 14] for 10.x.x.x:36810 failed with unknown error.
January 27 16:55:32 INFO [21]: (unknown) Task 8 [thread 21] for 10.x.x.x:36947 failed with unknown error.
January 27 16:55:32 INFO [32]: (unknown) Task 21 [thread 32] for 10.x.x.x:37106 failed with unknown error.
January 27 16:55:33 INFO [29]: (unknown) Task 18 [thread 29] for 10.x.x.x:37070 failed with unknown error.
January 27 16:55:33 INFO [10]: (unknown) Task 0 [thread 10] for 10.x.x.x:36770 failed with unknown error.
January 27 16:55:33 INFO [20]: (unknown) Task 7 [thread 20] for 10.x.x.x:36934 failed with unknown error.
January 27 16:55:33 INFO [11]: (unknown) Task 1 [thread 11] for 10.x.x.x:36798 failed with unknown error.
January 27 16:55:33 INFO [22]: (unknown) Task 9 [thread 22] for 127.0.0.1:36948 failed with unknown error.
January 27 16:55:33 INFO [24]: (unknown) Task 11 [thread 24] for 10.x.x.x:36968 failed with unknown error.
January 27 16:55:33 INFO [41]: (unknown) Task 33 [thread 41] for 10.x.x.x:37425 failed with unknown error.
 
At 7 19 PM it comes up
 
January 27 19:11:00 INFO [4]: Storage Cache Manager: cache transition from reloading to complete during cache load (no error)
January 27 19:19:59 INFO [4]: Storage Cache Manager: Cache loaded (73125152 SO nodes, 19442 DO nodes, 2571264 kb)
January 27 19:19:59 INFO [4]: Storage Cache Manager: cache load completed
January 27 19:19:59 INFO [4]: Storage Cache Manager: importing complete [thread 4]
 

 

TRUSS command tracking the spad process snippets:

read(23, 0xFFFFFFFF77FFBA80, 1024) Err#11 EAGAIN

 

pollsys(0x1003C2C38, 4, 0xFFFFFFFF6FAFB980, 0x00000000) = 0
/102: read(25, 0xFFFFFFFF6FAFBA80, 1024) Err#11 EAGAIN
 
102: read(25, 0xFFFFFFFF6FAFBA80, 1024) Err#11 EAGAIN
/3: pollsys(0xFFFFFFFF7C1FBC10, 0, 0xFFFFFFFF7C1FBCD0, 0x00000000) = 0
/3: time() = 1296126361
/3: time() = 1296126361
/37: pollsys(0xFFFFFFFF77DFACB0, 0, 0xFFFFFFFF77DFAD70, 0x00000000) = 0
/37: time() = 1296126361
/37: time() = 1296126361
/37: time() = 1296126361
/36: pollsys(0x1002C2AD8, 1, 0xFFFFFFFF77FFB980, 0x00000000) = 0
/103: pollsys(0xFFFFFFFF6F8FBCA0, 0, 0xFFFFFFFF6F8FBD60, 0x00000000) = 0
/36: read(23, 0xFFFFFFFF77FFBA80, 1024) Err#11 EAGAIN
/103: time() = 1296126361
/103: time() = 1296126361
/102: pollsys(0x1003C2C38, 4, 0xFFFFFFFF6FAFB980, 0x00000000) = 0
/102: read(25, 0xFFFFFFFF6FAFBA80, 1024) Err#11 EAGAIN
/3: pollsys(0xFFFFFFFF7C1FBC10, 0, 0xFFFFFFFF7C1FBCD0, 0x00000000) (sleeping...)
/37: pollsys(0xFFFFFFFF77DFACB0, 0, 0xFFFFFFFF77DFAD70, 0x00000000) (sleeping...)
/36: pollsys(0x1002C2AD8, 1, 0xFFFFFFFF77FFB980, 0x00000000) = 0
/103: pollsys(0xFFFFFFFF6F8FBCA0, 0, 0xFFFFFFFF6F8FBD60, 0x00000000) = 0
/36: read(23, 0xFFFFFFFF77FFBA80, 1024) Err#11 EAGAIN
/103: time() = 1296126362
/103: time() = 1296126362
/102: pollsys(0x1003C2C38, 4, 0xFFFFFFFF6FAFB980, 0x00000000) = 0
/102: read(25, 0xFFFFFFFF6FAFBA80, 1024) Err#11 EAGAIN
/3: pollsys(0xFFFFFFFF7C1FBC10, 0, 0xFFFFFFFF7C1FBCD0, 0x00000000) = 0
/3: time() = 1296126363
/3: time() = 1296126363
/36: pollsys(0x1002C2AD8, 1, 0xFFFFFFFF77FFB980, 0x00000000) = 0
/103: pollsys(0xFFFFFFFF6F8FBCA0, 0, 0xFFFFFFFF6F8FBD60, 0x00000000) = 0
/36: read(23, 0xFFFFFFFF77FFBA80, 1024) Err#11 EAGAIN
/103: time() = 1296126363
/103: time() = 1296126363
/102: pollsys(0x1003C2C38, 4, 0xFFFFFFFF6FAFB980, 0x00000000) = 0
/102: read(25, 0xFFFFFFFF6FAFBA80, 1024) Err#11 EAGAIN
/3: pollsys(0xFFFFFFFF7C1FBC10, 0, 0xFFFFFFFF7C1FBCD0, 0x00000000) (sleeping...)
/36: pollsys(0x1002C2AD8, 1, 0xFFFFFFFF77FFB980, 0x00000000) = 0
/103: pollsys(0xFFFFFFFF6F8FBCA0, 0, 0xFFFFFFFF6F8FBD60, 0x00000000) = 0
/36: read(23, 0xFFFFFFFF77FFBA80, 1024) Err#11 EAGAIN
/103: time() = 1296126364
/103: lwp_kill(105, SIG#0) Err#3 ESRCH
/103: lwp_create(0xFFFFFFFF6F8FB9B0, LWP_DETACHED|LWP_SUSPENDED, 0xFFFFFFFF6F8FB9AC) = 106
/106: lwp_create() (returning as new lwp ...) = 0
/103: lwp_continue(106) = 0
/106: setustack(0xFFFFFFFF703042C0)
/103: time() = 1296126364
/103: time() = 1296126364
/106: schedctl() = 0xFFFFFFFF7FF68670
/106: lwp_detach(106) Err#22 EINVAL
/106: time() = 1296126364
/106: openat(-3041965, "/DEDUP_DSK/log/spad", O_RDONLY|O_NDELAY|O_LARGEFILE) = 30
/106: fcntl(30, F_SETFD, 0x00000001) = 0
/106: fstat(30, 0xFFFFFFFF6EBFA7D0) = 0
/106: getdents(30, 0xFFFFFFFF7DA0E000, 8192) = 840
/106: lstat("/DEDUP_DSK/log/spad/spad.log", 0xFFFFFFFF6EBFA9C0) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x", 0xFFFFFFFF6EBFA9C0) = 0
/106: time() = 1296126364
/106: openat(-3041965, "/DEDUP_DSK/log/spad/10.x.x.x", O_RDONLY|O_NDELAY|O_LARGEFILE) = 31
/106: fcntl(31, F_SETFD, 0x00000001) = 0
/106: fstat(31, 0xFFFFFFFF6EBF9260) = 0
/106: getdents(31, 0xFFFFFFFF7DA10000, 8192) = 224
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/nbrmms", 0xFFFFFFFF6EBF9450) = 0
/106: time() = 1296126364
/106: openat(-3041965, "/DEDUP_DSK/log/spad/10.x.x.x/nbrmms", O_RDONLY|O_NDELAY|O_LARGEFILE) = 32
/106: fcntl(32, F_SETFD, 0x00000001) = 0
/106: fstat(32, 0xFFFFFFFF6EBF7CF0) = 0
/106: getdents(32, 0xFFFFFFFF7DA12000, 8192) = 72
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/nbrmms/spad", 0xFFFFFFFF6EBF7EE0) = 0
/106: time() = 1296126364
/106: openat(-3041965, "/DEDUP_DSK/log/spad/10.x.x.x/nbrmms/spad", O_RDONLY|O_NDELAY|O_LARGEFILE) = 33
/106: fcntl(33, F_SETFD, 0x00000001) = 0
/106: fstat(33, 0xFFFFFFFF6EBF6780) = 0
/106: getdents(33, 0xFFFFFFFF7DA14000, 8192) = 96
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/nbrmms/spad/1", 0xFFFFFFFF6EBF6970) = 0
/106: time() = 1296126364
/106: openat(-3041965, "/DEDUP_DSK/log/spad/10.x.x.x/nbrmms/spad/1", O_RDONLY|O_NDELAY|O_LARGEFILE) = 38
/106: fcntl(38, F_SETFD, 0x00000001) = 0
/106: fstat(38, 0xFFFFFFFF6EBF5210) = 0
/106: getdents(38, 0xFFFFFFFF7DA16000, 8192) = 96
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/nbrmms/spad/1/1362466041-1296115736.log", 0xFFFFFFFF6EBF5400) = 0
/106: getdents(38, 0xFFFFFFFF7DA16000, 8192) = 0
/106: close(38) = 0
/106: rmdir("/DEDUP_DSK/log/spad/10.x.x.x/nbrmms/spad/1") Err#17 EEXIST
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/nbrmms/spad/2", 0xFFFFFFFF6EBF6970) = 0
/106: time() = 1296126364
/106: openat(-3041965, "/DEDUP_DSK/log/spad/10.x.x.x/nbrmms/spad/2", O_RDONLY|O_NDELAY|O_LARGEFILE) = 38
/106: fcntl(38, F_SETFD, 0x00000001) = 0
/106: fstat(38, 0xFFFFFFFF6EBF5210) = 0
/106: getdents(38, 0xFFFFFFFF7DA16000, 8192) = 96
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/nbrmms/spad/2/2656725050-1296115737.log", 0xFFFFFFFF6EBF5400) = 0
/106: getdents(38, 0xFFFFFFFF7DA16000, 8192) = 0
/106: close(38) = 0
/106: rmdir("/DEDUP_DSK/log/spad/10.x.x.x/nbrmms/spad/2") Err#17 EEXIST
/106: getdents(33, 0xFFFFFFFF7DA14000, 8192) = 0
/106: close(33) = 0
/106: rmdir("/DEDUP_DSK/log/spad/10.x.x.x/nbrmms/spad") Err#17 EEXIST
/106: getdents(32, 0xFFFFFFFF7DA12000, 8192) = 0
/106: close(32) = 0
/106: rmdir("/DEDUP_DSK/log/spad/10.x.x.x/nbrmms") Err#17 EEXIST
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/spoold", 0xFFFFFFFF6EBF9450) = 0
/106: time() = 1296126364
/106: openat(-3041965, "/DEDUP_DSK/log/spad/10.x.x.x/spoold", O_RDONLY|O_NDELAY|O_LARGEFILE) = 32
/106: fcntl(32, F_SETFD, 0x00000001) = 0
/106: fstat(32, 0xFFFFFFFF6EBF7CF0) = 0
/106: getdents(32, 0xFFFFFFFF7DA12000, 8192) = 72
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/spoold/spad", 0xFFFFFFFF6EBF7EE0) = 0
/106: time() = 1296126364
/106: openat(-3041965, "/DEDUP_DSK/log/spad/10.x.x.x/spoold/spad", O_RDONLY|O_NDELAY|O_LARGEFILE) = 33
/106: fcntl(33, F_SETFD, 0x00000001) = 0
/106: fstat(33, 0xFFFFFFFF6EBF6780) = 0
/106: getdents(33, 0xFFFFFFFF7DA14000, 8192) = 96
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/spoold/spad/2", 0xFFFFFFFF6EBF6970) = 0
/106: time() = 1296126364
/106: openat(-3041965, "/DEDUP_DSK/log/spad/10.x.x.x/spoold/spad/2", O_RDONLY|O_NDELAY|O_LARGEFILE) = 38
/106: fcntl(38, F_SETFD, 0x00000001) = 0
/106: fstat(38, 0xFFFFFFFF6EBF5210) = 0
/106: getdents(38, 0xFFFFFFFF7DA16000, 8192) = 96
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/spoold/spad/2/2836336566-1296115605.log", 0xFFFFFFFF6EBF5400) = 0
/106: getdents(38, 0xFFFFFFFF7DA16000, 8192) = 0
/106: close(38) = 0
/106: rmdir("/DEDUP_DSK/log/spad/10.x.x.x/spoold/spad/2") Err#17 EEXIST
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/spoold/spad/1", 0xFFFFFFFF6EBF6970) = 0
/106: time() = 1296126364
/106: openat(-3041965, "/DEDUP_DSK/log/spad/10.x.x.x/spoold/spad/1", O_RDONLY|O_NDELAY|O_LARGEFILE) = 38
/106: fcntl(38, F_SETFD, 0x00000001) = 0
/106: fstat(38, 0xFFFFFFFF6EBF5210) = 0
/106: getdents(38, 0xFFFFFFFF7DA16000, 8192) = 96
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/spoold/spad/1/1019826623-1293527726.log", 0xFFFFFFFF6EBF5400) = 0
/106: getdents(38, 0xFFFFFFFF7DA16000, 8192) = 0
/106: close(38) = 0
/106: rmdir("/DEDUP_DSK/log/spad/10.x.x.x/spoold/spad/1") Err#17 EEXIST
/106: getdents(33, 0xFFFFFFFF7DA14000, 8192) = 0
/106: close(33) = 0
/106: rmdir("/DEDUP_DSK/log/spad/10.x.x.x/spoold/spad") Err#17 EEXIST
/106: getdents(32, 0xFFFFFFFF7DA12000, 8192) = 0
/106: close(32) = 0
/106: rmdir("/DEDUP_DSK/log/spad/10.x.x.x/spoold") Err#17 EEXIST
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo", 0xFFFFFFFF6EBF9450) = 0
/106: time() = 1296126364
/106: openat(-3041965, "/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo", O_RDONLY|O_NDELAY|O_LARGEFILE) = 32
/106: fcntl(32, F_SETFD, 0x00000001) = 0
/106: fstat(32, 0xFFFFFFFF6EBF7CF0) = 0
/106: getdents(32, 0xFFFFFFFF7DA12000, 8192) = 72
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad", 0xFFFFFFFF6EBF7EE0) = 0
/106: time() = 1296126364
/106: openat(-3041965, "/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad", O_RDONLY|O_NDELAY|O_LARGEFILE) = 33
/106: fcntl(33, F_SETFD, 0x00000001) = 0
/106: fstat(33, 0xFFFFFFFF6EBF6780) = 0
/106: getdents(33, 0xFFFFFFFF7DA14000, 8192) = 264
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1", 0xFFFFFFFF6EBF6970) = 0
/106: time() = 1296126364
/106: openat(-3041965, "/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1", O_RDONLY|O_NDELAY|O_LARGEFILE) = 38
/106: fcntl(38, F_SETFD, 0x00000001) = 0
/106: fstat(38, 0xFFFFFFFF6EBF5210) = 0
/106: getdents(38, 0xFFFFFFFF7DA16000, 8192) = 8160
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1042795352-1295645280.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1535000819-1295652782.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/165695946-1295653502.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1881993170-1295653684.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1828624906-1295653742.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1673306990-1295653802.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1122405259-1295665085.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1542276918-1295671510.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1174354856-1295671627.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1567313603-1295673848.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1289862877-1295674811.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1788906120-1295674811.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1348159275-1295675048.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/160988414-1295587791.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/194204943-1295587851.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1098252447-1295606697.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1529861935-1295606937.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1967478963-1296007794.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1897970658-1296007914.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1453016344-1296051051.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/177968881-1296051167.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1139214462-1296069952.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1545569583-1296069952.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1944393314-1296070972.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1043758619-1296071632.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1963079192-1296071812.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1556169062-1296072113.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1184412909-1295587671.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1429186886-1295587791.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/187500841-1295606583.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1799955887-1295606697.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1974297891-1295640719.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1586045118-1295640779.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1647230094-1295643719.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1908137203-1295644079.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1711075855-1295662927.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/183605560-1295662927.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1718138177-1295662928.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1138552369-1295663045.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/113088727-1295663045.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1957502013-1295666586.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1709390252-1295591512.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1168161431-1295599374.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1560603784-1295606517.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1585530907-1295606517.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1893438658-1295617602.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/124976932-1295617782.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1339656705-1295617966.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1673764075-1295618022.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1816543461-1295734959.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1159517308-1295735017.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1670959754-1295735377.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1559514913-1295735737.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1782448483-1295735797.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1329912431-1295736517.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1839296168-1295591332.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1036871901-1295591332.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1909939078-1295603155.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/171469725-1295674811.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/184564291-1295693713.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1447906186-1295693773.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1406465795-1295738138.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1278313427-1295738138.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1975528341-1295773968.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/170924624-1295774028.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1455581276-1295774088.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1225431182-1295774268.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1187226414-1295774448.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1473341716-1295774448.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1192036681-1295591092.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1260440809-1295599254.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1591464560-1295599614.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1584907617-1295724632.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/146091130-1295729913.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1609381525-1295729973.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1743492716-1295730155.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1130913281-1295730275.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1894342915-1295730455.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1807156282-1295730515.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1376894679-1295730515.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1936607807-1295733216.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1632105725-1295733276.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1350961004-1295733876.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1844835873-1295594696.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/179819691-1295594753.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1495421420-1295595053.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/194402176-1295602735.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1159269359-1295729853.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1398407370-1295729913.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/120672343-1295730338.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/1180301822-1295732136.log", 0xFFFFFFFF6EBF5400) = 0
/106: lstat("/DEDUP_DSK/log/spad/10.x.x.x/bpstsinfo/spad/1/107190057-1295744862.log", 0xFFFFFFFF6EBF5400) = 0

AAlmroth
Level 6
Partner Accredited

Perhaps you experience the condition outlined in the TN at http://www.symantec.com/business/support/index?page=content&id=TECH141554&key=15143&actp=LIST

You will have to open a support case and request the EEB.

 

/A