Journaling Mailbox will not Archive

[Chad_Petrie_2]

I am currently running EV 6.0 SP2.

I have 4 Exchange 2003 servers journaling mail to 4 separate mailboxes on a separate Exchange box. For archiving the journalled mail I have 2 dedicated EV boxes, each one handling 2 of the journal mailboxes.

My question is this, starting 2 days ago, one of the journal mailboxes has stopped archiving, and I am getting events saying that the number of messages is over the threshold and it will pause for 1 minute. The problem is it is continually pausing and not doing any archiving. The other archiving task for this box is keeping up with its journal mailbox so it is only 1 of 2 mailboxes for this server that is having the problem.

Does anyone have any suggestions as to how to force this mailbox to start journalling?

Thanks.

[Jason_Szeto]

It sounds like the EV server can't keep up with indexing your items. Are the 2 journal mailboxes on that EV server getting a lot more mail than the other EV server?

You might want to do a Dtrace of the journal task and indexing and see what errors it's reporting.

[Chad_Petrie_2]

Usually the servers can keep up just fine with the amount of mail, and the load is split pretty evenly between all boxes. I will attempt to run a dtrace.

[Chad_Petrie_2]

Here are the results of a dtrace I just ran. I threw a lot of counters in there so it is a little long. Let me know if you think there is something else to be looking for.



DTrace trace log


Enabled Trace options

Id Name Detail Include Events
3 - ArchivePoints Verbose Yes
4 - ArchiveTask Verbose Yes
27 - EVRights Verbose Yes
56 - StorageArchive Verbose Yes
63 - StorageServer Verbose Yes

-----


Display Filter:
Include strings:
EV-
EV:
EV~

Exclude strings:
CMMStream
DBFramework
DirectoryConnection
DirectoryVault
-----


Running in Terminal Services session...
Monitoring debug output from processes running in the console session
Monitoring debug output from processes running in the current Terminal Services session

815:12:59.117 (StorageServer)<1968>EV:LCServiceModule::Handler (Entry) |
915:12:59.117 (StorageServer)<1968>EV:LCServiceModule::Handler|Received SERVICE_CONTROL_INTERROGATE request from SCM
1015:12:59.117 (StorageServer)<1968>EV:MCServiceModule::Handler (Exit) |
1115:13:28.508 (JournalTask)<1124>EV~WThe number of items pending indexing for the archive has grown above the threshold limit. This Task will pause for 1 minute(s) to allow the backlog to clear. |Task: |Target: /O=C.H. ROBINSON COMPANY/OU=CHR/CN=RECIPIENTS/CN=SVCMAILJOURNAL5 |Archive Name: Mail Journal 5 |Archive Id: 1A8D74CA533A7A54D84D41B86579D9E5A1110000evaultchr |
1215:13:37.742 (StorageServer)<4180>EV:HCDotNETServerManager::ServerManagerInvoke Method invoked=GetCurrentState hr=00000000
1315:13:37.742 (StorageServer)<4180>EV:HCDotNETServerManager::ThreadRoutine GetCurrentState ==> Running (hr=00000000)
1415:14:29.507 (JournalTask)<1124>EV~WThe number of items pending indexing for the archive has grown above the threshold limit. This Task will pause for 1 minute(s) to allow the backlog to clear. |Task: |Target: /O=C.H. ROBINSON COMPANY/OU=CHR/CN=RECIPIENTS/CN=SVCMAILJOURNAL5 |Archive Name: Mail Journal 5 |Archive Id: 1A8D74CA533A7A54D84D41B86579D9E5A1110000evaultchr |
1515:14:37.742 (StorageServer)<4180>EV:HCDotNETServerManager::ServerManagerInvoke Method invoked=GetCurrentState hr=00000000
1615:14:37.742 (StorageServer)<4180>EV:HCDotNETServerManager::ThreadRoutine GetCurrentState ==> Running (hr=00000000)
1715:15:30.522 (JournalTask)<1124>EV~WThe number of items pending indexing for the archive has grown above the threshold limit. This Task will pause for 1 minute(s) to allow the backlog to clear. |Task: |Target: /O=C.H. ROBINSON COMPANY/OU=CHR/CN=RECIPIENTS/CN=SVCMAILJOURNAL5 |Archive Name: Mail Journal 5 |Archive Id: 1A8D74CA533A7A54D84D41B86579D9E5A1110000evaultchr |
1815:15:37.741 (StorageServer)<4180>EV:HCDotNETServerManager::ServerManagerInvoke Method invoked=GetCurrentState hr=00000000
1915:15:37.741 (StorageServer)<4180>EV:HCDotNETServerManager::ThreadRoutine GetCurrentState ==> Running (hr=00000000)
2015:15:59.257 (StorageServer)<1968>EV:LCServiceModule::Handler (Entry) |
2115:15:59.257 (StorageServer)<1968>EV:LCServiceModule::Handler|Received SERVICE_CONTROL_INTERROGATE request from SCM
2215:15:59.257 (StorageServer)<1968>EV:MCServiceModule::Handler (Exit) |
2315:16:31.272 (JournalTask)<1124>EV~WThe number of items pending indexing for the archive has grown above the threshold limit. This Task will pause for 1 minute(s) to allow the backlog to clear. |Task: |Target: /O=C.H. ROBINSON COMPANY/OU=CHR/CN=RECIPIENTS/CN=SVCMAILJOURNAL5 |Archive Name: Mail Journal 5 |Archive Id: 1A8D74CA533A7A54D84D41B86579D9E5A1110000evaultchr |
2415:16:37.741 (StorageServer)<4180>EV:HCDotNETServerManager::ServerManagerInvoke Method invoked=GetCurrentState hr=00000000
2515:16:37.741 (StorageServer)<4180>EV:HCDotNETServerManager::ThreadRoutine GetCurrentState ==> Running (hr=00000000)
2615:17:32.147 (JournalTask)<1124>EV~WThe number of items pending indexing for the archive has grown above the threshold limit. This Task will pause for 1 minute(s) to allow the backlog to clear. |Task: |Target: /O=C.H. ROBINSON COMPANY/OU=CHR/CN=RECIPIENTS/CN=SVCMAILJOURNAL5 |Archive Name: Mail Journal 5 |Archive Id: 1A8D74CA533A7A54D84D41B86579D9E5A1110000evaultchr |
2715:17:37.740 (StorageServer)<4180>EV:HCDotNETServerManager::ServerManagerInvoke Method invoked=GetCurrentState hr=00000000
2815:17:37.740 (StorageServer)<4180>EV:HCDotNETServerManager::ThreadRoutine GetCurrentState ==> Running (hr=00000000)
2915:18:32.896 (JournalTask)<1124>EV~WThe number of items pending indexing for the archive has grown above the threshold limit. This Task will pause for 1 minute(s) to allow the backlog to clear. |Task: |Target: /O=C.H. ROBINSON COMPANY/OU=CHR/CN=RECIPIENTS/CN=SVCMAILJOURNAL5 |Archive Name: Mail Journal 5 |Archive Id: 1A8D74CA533A7A54D84D41B86579D9E5A1110000evaultchr |
3015:18:37.740 (StorageServer)<4180>EV:HCDotNETServerManager::ServerManagerInvoke Method invoked=GetCurrentState hr=00000000
3115:18:37.740 (StorageServer)<4180>EV:HCDotNETServerManager::ThreadRoutine GetCurrentState ==> Running (hr=00000000)
3215:19:00.209 (StorageServer)<1968>EV:LCServiceModule::Handler (Entry) |
3315:19:00.209 (StorageServer)<1968>EV:LCServiceModule::Handler|Received SERVICE_CONTROL_INTERROGATE request from SCM
3415:19:00.209 (StorageServer)<1968>EV:MCServiceModule::Handler (Exit) |
3515:19:34.130 (JournalTask)<1124>EV~WThe number of items pending indexing for the archive has grown above the threshold limit. This Task will pause for 1 minute(s) to allow the backlog to clear. |Task: |Target: /O=C.H. ROBINSON COMPANY/OU=CHR/CN=RECIPIENTS/CN=SVCMAILJOURNAL5 |Archive Name: Mail Journal 5 |Archive Id: 1A8D74CA533A7A54D84D41B86579D9E5A1110000evaultchr |
3615:19:37.740 (StorageServer)<4180>EV:HCDotNETServerManager::ServerManagerInvoke Method invoked=GetCurrentState hr=00000000
3715:19:37.740 (StorageServer)<4180>EV:HCDotNETServerManager::ThreadRoutine GetCurrentState ==> Running (hr=00000000)
3815:20:35.239 (JournalTask)<1124>EV~WThe number of items pending indexing for the archive has grown above the threshold limit. This Task will pause for 1 minute(s) to allow the backlog to clear. |Task: |Target: /O=C.H. ROBINSON COMPANY/OU=CHR/CN=RECIPIENTS/CN=SVCMAILJOURNAL5 |Archive Name: Mail Journal 5 |Archive Id: 1A8D74CA533A7A54D84D41B86579D9E5A1110000evaultchr |
3915:20:37.739 (StorageServer)<4180>EV:HCDotNETServerManager::ServerManagerInvoke Method invoked=GetCurrentState hr=00000000
4015:20:37.739 (StorageServer)<4180>EV:HCDotNETServerManager::ThreadRoutine GetCurrentState ==> Running (hr=00000000)
4115:21:36.489 (JournalTask)<1124>EV~WThe number of items pending indexing for the archive has grown above the threshold limit. This Task will pause for 1 minute(s) to allow the backlog to clear. |Task: |Target: /O=C.H. ROBINSON COMPANY/OU=CHR/CN=RECIPIENTS/CN=SVCMAILJOURNAL5 |Archive Name: Mail Journal 5 |Archive Id: 1A8D74CA533A7A54D84D41B86579D9E5A1110000evaultchr |
4215:21:37.739 (StorageServer)<4180>EV:HCDotNETServerManager::ServerManagerInvoke Method invoked=GetCurrentState hr=00000000
4315:21:37.739 (StorageServer)<4180>EV:HCDotNETServerManager::ThreadRoutine GetCurrentState ==> Running (hr=00000000)
4415:22:04.098 (StorageServer)<1968>EV:LCServiceModule::Handler (Entry) |
4515:22:04.098 (StorageServer)<1968>EV:LCServiceModule::Handler|Received SERVICE_CONTROL_INTERROGATE request from SCM
4615:22:04.098 (StorageServer)<1968>EV:MCServiceModule::Handler (Exit) |
4715:22:37.285 (JournalTask)<1124>EV~WThe number of items pending indexing for the archive has grown above the threshold limit. This Task will pause for 1 minute(s) to allow the backlog to clear. |Task: |Target: /O=C.H. ROBINSON COMPANY/OU=CHR/CN=RECIPIENTS/CN=SVCMAILJOURNAL5 |Archive Name: Mail Journal 5 |Archive Id: 1A8D74CA533A7A54D84D41B86579D9E5A1110000evaultchr |
4815:22:37.739 (StorageServer)<4180>EV:HCDotNETServerManager::ServerManagerInvoke Method invoked=GetCurrentState hr=00000000
4915:22:37.739 (StorageServer)<4180>EV:HCDotNETServerManager::ThreadRoutine GetCurrentState ==> Running (hr=00000000)
5015:23:37.738 (StorageServer)<4180>EV:HCDotNETServerManager::ServerManagerInvoke Method invoked=GetCurrentState hr=00000000
5115:23:37.738 (StorageServer)<4180>EV:HCDotNETServerManager::ThreadRoutine GetCurrentState ==> Running (hr=00000000)
5215:23:38.285 (JournalTask)<1124>EV~WThe number of items pending indexing for the archive has grown above the threshold limit. This Task will pause for 1 minute(s) to allow the backlog to clear. |Task: |Target: /O=C.H. ROBINSON COMPANY/OU=CHR/CN=RECIPIENTS/CN=SVCMAILJOURNAL5 |Archive Name: Mail Journal 5 |Archive Id: 1A8D74CA533A7A54D84D41B86579D9E5A1110000evaultchr |
5315:24:37.738 (StorageServer)<4180>EV:HCDotNETServerManager::ServerManagerInvoke Method invoked=GetCurrentState hr=00000000
5415:24:37.738 (StorageServer)<4180>EV:HCDotNETServerManager::ThreadRoutine GetCurrentState ==> Running (hr=00000000)
5515:24:48.785 (JournalTask)<1124>EV~WThe number of items pending indexing for the archive has grown above the threshold limit. This Task will pause for 1 minute(s) to allow the backlog to clear. |Task: |Target: /O=C.H. ROBINSON COMPANY/OU=CHR/CN=RECIPIENTS/CN=SVCMAILJOURNAL5 |Archive Name: Mail Journal 5 |Archive Id: 1A8D74CA533A7A54D84D41B86579D9E5A1110000evaultchr |
5615:25:05.550 (StorageServer)<1968>EV:LCServiceModule::Handler (Entry) |
5715:25:05.550 (StorageServer)<1968>EV:LCServiceModule::Handler|Received SERVICE_CONTROL_INTERROGATE request from SCM
5815:25:05.550 (StorageServer)<1968>EV:MCServiceModule::Handler (Exit) |
5915:25:37.737 (StorageServer)<4180>EV:HCDotNETServerManager::ServerManagerInvoke Method invoked=GetCurrentState hr=00000000
6015:25:37.737 (StorageServer)<4180>EV:HCDotNETServerManager::ThreadRoutine GetCurrentState ==> Running (hr=00000000)
6115:25:52.487 (JournalTask)<1124>EV~WThe number of items pending indexing for the archive has grown above the threshold limit. This Task will pause for 1 minute(s) to allow the backlog to clear. |Task: |Target: /O=C.H. ROBINSON COMPANY/OU=CHR/CN=RECIPIENTS/CN=SVCMAILJOURNAL5 |Archive Name: Mail Journal 5 |Archive Id: 1A8D74CA533A7A54D84D41B86579D9E5A1110000evaultchr |
6215:26:37.737 (StorageServer)<4180>EV:HCDotNETServerManager::ServerManagerInvoke Method invoked=GetCurrentState hr=00000000
6315:26:37.737 (StorageServer)<4180>EV:HCDotNETServerManager::ThreadRoutine GetCurrentState ==> Running (hr=00000000)
6415:26:53.377 (JournalTask)<1124>EV~WThe number of items pending indexing for the archive has grown above the threshold limit. This Task will pause for 1 minute(s) to allow the backlog to clear. |Task: |Target: /O=C.H. ROBINSON COMPANY/OU=CHR/CN=RECIPIENTS/CN=SVCMAILJOURNAL5 |Archive Name: Mail Journal 5 |Archive Id: 1A8D74CA533A7A54D84D41B86579D9E5A1110000evaultchr |
6515:27:37.737 (StorageServer)<4180>EV:HCDotNETServerManager::ServerManagerInvoke Method invoked=GetCurrentState hr=00000000
6615:27:37.737 (StorageServer)<4180>EV:HCDotNETServerManager::ThreadRoutine GetCurrentState ==> Running (hr=00000000)
6715:27:54.174 (JournalTask)<1124>EV~WThe number of items pending indexing for the archive has grown above the threshold limit. This Task will pause for 1 minute(s) to allow the backlog to clear. |Task: |Target: /O=C.H. ROBINSON COMPANY/OU=CHR/CN=RECIPIENTS/CN=SVCMAILJOURNAL5 |Archive Name: Mail Journal 5 |Archive Id: 1A8D74CA533A7A54D84D41B86579D9E5A1110000evaultchr |
6815:28:12.221 (StorageServer)<1968>EV:LCServiceModule::Handler (Entry) |
6915:28:12.221 (StorageServer)<1968>EV:LCServiceModule::Handler|Received SERVICE_CONTROL_INTERROGATE request from SCM
7015:28:12.221 (StorageServer)<1968>EV:MCServiceModule::Handler (Exit) |
7115:28:37.736 (StorageServer)<4180>EV:HCDotNETServerManager::ServerManagerInvoke Method invoked=GetCurrentState hr=00000000
7215:28:37.736 (StorageServer)<4180>EV:HCDotNETServerManager::ThreadRoutine GetCurrentState ==> Running (hr=00000000)
7315:29:02.080 (JournalTask)<1124>EV~WThe number of items pending indexing for the archive has grown above the threshold limit. This Task will pause for 1 minute(s) to allow the backlog to clear. |Task: |Target: /O=C.H. ROBINSON COMPANY/OU=CHR/CN=RECIPIENTS/CN=SVCMAILJOURNAL5 |Archive Name: Mail Journal 5 |Archive Id: 1A8D74CA533A7A54D84D41B86579D9E5A1110000evaultchr |
7415:29:37.736 (StorageServer)<4180>EV:HCDotNETServerManager::ServerManagerInvoke Method invoked=GetCurrentState hr=00000000
7515:29:37.736 (StorageServer)<4180>EV:HCDotNETServerManager::ThreadRoutine GetCurrentState ==> Running (hr=00000000)
7615:30:03.345 (JournalTask)<1124>EV~WThe number of items pending indexing for the archive has grown above the threshold limit. This Task will pause for 1 minute(s) to allow the backlog to clear. |Task: |Target: /O=C.H. ROBINSON COMPANY/OU=CHR/CN=RECIPIENTS/CN=SVCMAILJOURNAL5 |Archive Name: Mail Journal 5 |Archive Id: 1A8D74CA533A7A54D84D41B86579D9E5A1110000evaultchr |
7715:30:37.735 (StorageServer)<4180>EV:HCDotNETServerManager::ServerManagerInvoke Method invoked=GetCurrentState hr=00000000
7815:30:37.735 (StorageServer)<4180>EV:HCDotNETServerManager::ThreadRoutine GetCurrentState ==> Running (hr=00000000)
7915:31:07.641 (JournalTask)<1124>EV~WThe number of items pending indexing for the archive has grown above the threshold limit. This Task will pause for 1 minute(s) to allow the backlog to clear. |Task: |Target: /O=C.H. ROBINSON COMPANY/OU=CHR/CN=RECIPIENTS/CN=SVCMAILJOURNAL5 |Archive Name: Mail Journal 5 |Archive Id: 1A8D74CA533A7A54D84D41B86579D9E5A1110000evaultchr |
8015:31:13.251 (StorageServer)<1968>EV:LCServiceModule::Handler (Entry) |
8115:31:13.251 (StorageServer)<1968>EV:LCServiceModule::Handler|Received SERVICE_CONTROL_INTERROGATE request from SCM
8215:31:13.251 (StorageServer)<1968>EV:MCServiceModule::Handler (Exit) |
8315:31:37.735 (StorageServer)<4180>EV:HCDotNETServerManager::ServerManagerInvoke Method invoked=GetCurrentState hr=00000000
8415:31:37.735 (StorageServer)<4180>EV:HCDotNETServerManager::ThreadRoutine GetCurrentState ==> Running (hr=00000000)
8515:32:08.829 (JournalTask)<1124>EV~WThe number of items pending indexing for the archive has grown above the threshold limit. This Task will pause for 1 minute(s) to allow the backlog to clear. |Task: |Target: /O=C.H. ROBINSON COMPANY/OU=CHR/CN=RECIPIENTS/CN=SVCMAILJOURNAL5 |Archive Name: Mail Journal 5 |Archive Id: 1A8D74CA533A7A54D84D41B86579D9E5A1110000evaultchr |
8615:32:37.735 (StorageServer)<4180>EV:HCDotNETServerManager::ServerManagerInvoke Method invoked=GetCurrentState hr=00000000
8715:32:37.735 (StorageServer)<4180>EV:HCDotNETServerManager::ThreadRoutine GetCurrentState ==> Running (hr=00000000)
8815:33:12.297 (JournalTask)<1124>EV~WThe number of items pending indexing for the archive has grown above the threshold limit. This Task will pause for 1 minute(s) to allow the backlog to clear. |Task: |Target: /O=C.H. ROBINSON COMPANY/OU=CHR/CN=RECIPIENTS/CN=SVCMAILJOURNAL5 |Archive Name: Mail Journal 5 |Archive Id: 1A8D74CA533A7A54D84D41B86579D9E5A1110000evaultchr |
8915:33:37.734 (StorageServer)<4180>EV:HCDotNETServerManager::ServerManagerInvoke Method invoked=GetCurrentState hr=00000000
9015:33:37.734 (StorageServer)<4180>EV:HCDotNETServerManager::ThreadRoutine GetCurrentState ==> Running (hr=00000000)
9115:34:13.703 (StorageServer)<1968>EV:LCServiceModule::Handler (Entry) |
9215:34:13.703 (StorageServer)<1968>EV:LCServiceModule::Handler|Received SERVICE_CONTROL_INTERROGATE request from SCM
9315:34:13.703 (StorageServer)<1968>EV:MCServiceModule::Handler (Exit) |
9415:34:13.859 (JournalTask)<1124>EV~WThe number of items pending indexing for the archive has grown above the threshold limit. This Task will pause for 1 minute(s) to allow the backlog to clear. |Task: |Target: /O=C.H. ROBINSON COMPANY/OU=CHR/CN=RECIPIENTS/CN=SVCMAILJOURNAL5 |Archive Name: Mail Journal 5 |Archive Id: 1A8D74CA533A7A54D84D41B86579D9E5A1110000evaultchr |
9515:34:37.734 (StorageServer)<4180>EV:HCDotNETServerManager::ServerManagerInvoke Method invoked=GetCurrentState hr=00000000
9615:34:37.734 (StorageServer)<4180>EV:HCDotNETServerManager::ThreadRoutine GetCurrentState ==> Running (hr=00000000)
9715:35:14.546 (JournalTask)<1124>EV~WThe number of items pending indexing for the archive has grown above the threshold limit. This Task will pause for 1 minute(s) to allow the backlog to clear. |Task: |Target: /O=C.H. ROBINSON COMPANY/OU=CHR/CN=RECIPIENTS/CN=SVCMAILJOURNAL5 |Archive Name: Mail Journal 5 |Archive Id: 1A8D74CA533A7A54D84D41B86579D9E5A1110000evaultchr |
9815:35:37.734 (StorageServer)<4180>EV:HCDotNETServerManager::ServerManagerInvoke Method invoked=GetCurrentState hr=00000000
9915:35:37.734 (StorageServer)<4180>EV:HCDotNETServerManager::ThreadRoutine GetCurrentState ==> Running (hr=00000000)
10015:36:15.374 (JournalTask)<1124>EV~WThe number of items pending indexing for the archive has grown above the threshold limit. This Task will pause for 1 minute(s) to allow the backlog to clear. |Task: |Target: /O=C.H. ROBINSON COMPANY/OU=CHR/CN=RECIPIENTS/CN=SVCMAILJOURNAL5 |Archive Name: Mail Journal 5 |Archive Id: 1A8D74CA533A7A54D84D41B86579D9E5A1110000evaultchr |
10115:36:37.733 (StorageServer)<4180>EV:HCDotNETServerManager::ServerManagerInvoke Method invoked=GetCurrentState hr=00000000
10215:36:37.733 (StorageServer)<4180>EV:HCDotNETServerManager::ThreadRoutine GetCurrentState ==> Running (hr=00000000)
10315:37:14.420 (StorageServer)<1968>EV:LCServiceModule::Handler (Entry) |
10415:37:14.420 (StorageServer)<1968>EV:LCServiceModule::Handler|Received SERVICE_CONTROL_INTERROGATE request from SCM
10515:37:14.420 (StorageServer)<1968>EV:MCServiceModule::Handler (Exit) |
10615:37:16.264 (JournalTask)<1124>EV~WThe number of items pending indexing for the archive has grown above the threshold limit. This Task will pause for 1 minute(s) to allow the backlog to clear. |Task: |Target: /O=C.H. ROBINSON COMPANY/OU=CHR/CN=RECIPIENTS/CN=SVCMAILJOURNAL5 |Archive Name: Mail Journal 5 |Archive Id: 1A8D74CA533A7A54D84D41B86579D9E5A1110000evaultchr |
10715:37:37.733 (StorageServer)<4180>EV:HCDotNETServerManager::ServerManagerInvoke Method invoked=GetCurrentState hr=00000000
10815:37:37.733 (StorageServer)<4180>EV:HCDotNETServerManager::ThreadRoutine GetCurrentState ==> Running (hr=00000000)
10915:38:22.951 (JournalTask)<1124>EV~WThe number of items pending indexing for the archive has grown above the threshold limit. This Task will pause for 1 minute(s) to allow the backlog to clear. |Task: |Target: /O=C.H. ROBINSON COMPANY/OU=CHR/CN=RECIPIENTS/CN=SVCMAILJOURNAL5 |Archive Name: Mail Journal 5 |Archive Id: 1A8D74CA533A7A54D84D41B86579D9E5A1110000evaultchr |
11015:38:37.732 (StorageServer)<4180>EV:HCDotNETServerManager::ServerManagerInvoke Method invoked=GetCurrentState hr=00000000
11115:38:37.732 (StorageServer)<4180>EV:HCDotNETServerManager::ThreadRoutine GetCurrentState ==> Running (hr=00000000)
11215:39:24.170 (JournalTask)<1124>EV~WThe number of items pending indexing for the archive has grown above the threshold limit. This Task will pause for 1 minute(s) to allow the backlog to clear. |Task: |Target: /O=C.H. ROBINSON COMPANY/OU=CHR/CN=RECIPIENTS/CN=SVCMAILJOURNAL5 |Archive Name: Mail Journal 5 |Archive Id: 1A8D74CA533A7A54D84D41B86579D9E5A1110000evaultchr |
11315:39:37.732 (StorageServer)<4180>EV:HCDotNETServerManager::ServerManagerInvoke Method invoked=GetCurrentState hr=00000000
11415:39:37.732 (StorageServer)<4180>EV:HCDotNETServerManager::ThreadRoutine GetCurrentState ==> Running (hr=00000000)
11515:40:15.466 (StorageServer)<1968>EV:LCServiceModule::Handler (Entry) |
11615:40:15.466 (StorageServer)<1968>EV:LCServiceModule::Handler|Received SERVICE_CONTROL_INTERROGATE request from SCM
11715:40:15.466 (StorageServer)<1968>EV:MCServiceModule::Handler (Exit) |
11815:40:25.216 (JournalTask)<1124>EV~WThe number of items pending indexing for the archive has grown above the threshold limit. This Task will pause for 1 minute(s) to allow the backlog to clear. |Task: |Target: /O=C.H. ROBINSON COMPANY/OU=CHR/CN=RECIPIENTS/CN=SVCMAILJOURNAL5 |Archive Name: Mail Journal 5 |Archive Id: 1A8D74CA533A7A54D84D41B86579D9E5A1110000evaultchr |
11915:40:37.732 (StorageServer)<4180>EV:HCDotNETServerManager::ServerManagerInvoke Method invoked=GetCurrentState hr=00000000
12015:40:37.732 (StorageServer)<4180>EV:HCDotNETServerManager::ThreadRoutine GetCurrentState ==> Running (hr=00000000)
12115:41:31.559 (JournalTask)<1124>EV~WThe number of items pending indexing for the archive has grown above the threshold limit. This Task will pause for 1 minute(s) to allow the backlog to clear. |Task: |Target: /O=C.H. ROBINSON COMPANY/OU=CHR/CN=RECIPIENTS/CN=SVCMAILJOURNAL5 |Archive Name: Mail Journal 5 |Archive Id: 1A8D74CA533A7A54D84D41B86579D9E5A1110000evaultchr |
12215:41:37.731 (StorageServer)<4180>EV:HCDotNETServerManager::ServerManagerInvoke Method invoked=GetCurrentState hr=00000000
12315:41:37.731 (StorageServer)<4180>EV:HCDotNETServerManager::ThreadRoutine GetCurrentState ==> Running (hr=00000000)
12415:42:34.403 (JournalTask)<1124>EV~WThe number of items pending indexing for the archive has grown above the threshold limit. This Task will pause for 1 minute(s) to allow the backlog to clear. |Task: |Target: /O=C.H. ROBINSON COMPANY/OU=CHR/CN=RECIPIENTS/CN=SVCMAILJOURNAL5 |Archive Name: Mail Journal 5 |Archive Id: 1A8D74CA533A7A54D84D41B86579D9E5A1110000evaultchr |
12515:42:37.731 (StorageServer)<4180>EV:HCDotNETServerManager::ServerManagerInvoke Method invoked=GetCurrentState hr=00000000
12615:42:37.731 (StorageServer)<4180>EV:HCDotNETServerManager::ThreadRoutine GetCurrentState ==> Running (hr=00000000)
12715:43:16.121 (StorageServer)<1968>EV:LCServiceModule::Handler (Entry) |
12815:43:16.121 (StorageServer)<1968>EV:LCServiceModule::Handler|Received SERVICE_CONTROL_INTERROGATE request from SCM
12915:43:16.121 (StorageServer)<1968>EV:MCServiceModule::Handler (Exit) |
13015:43:35.684 (JournalTask)<1124>EV~WThe number of items pending indexing for the archive has grown above the threshold limit. This Task will pause for 1 minute(s) to allow the backlog to clear. |Task: |Target: /O=C.H. ROBINSON COMPANY/OU=CHR/CN=RECIPIENTS/CN=SVCMAILJOURNAL5 |Archive Name: Mail Journal 5 |Archive Id: 1A8D74CA533A7A54D84D41B86579D9E5A1110000evaultchr |
13115:43:37.730 (StorageServer)<4180>EV:HCDotNETServerManager::ServerManagerInvoke Method invoked=GetCurrentState hr=00000000
13215:43:37.730 (StorageServer)<4180>EV:HCDotNETServerManager::ThreadRoutine GetCurrentState ==> Running (hr=00000000)
13315:43:42.777 (JournalTask)<5544>EV~IThe Journal Task 'Journal Task for CHR419 J5' against CHR419 has stopped |
13415:44:37.730 (StorageServer)<4180>EV:HCDotNETServerManager::ServerManagerInvoke Method invoked=GetCurrentState hr=00000000
13515:44:37.730 (StorageServer)<4180>EV:HCDotNETServerManager::ThreadRoutine GetCurrentState ==> Running (hr=00000000)
13615:45:37.730 (StorageServer)<4180>EV:HCDotNETServerManager::ServerManagerInvoke Method invoked=GetCurrentState hr=00000000
13715:45:37.730 (StorageServer)<4180>EV:HCDotNETServerManager::ThreadRoutine GetCurrentState ==> Running (hr=00000000)
13815:46:19.901 (StorageServer)<1968>EV:LCServiceModule::Handler (Entry) |
13915:46:19.901 (StorageServer)<1968>EV:LCServiceModule::Handler|Received SERVICE_CONTROL_INTERROGATE request from SCM
14015:46:19.901 (StorageServer)<1968>EV:MCServiceModule::Handler (Exit) |
14115:46:37.729 (StorageServer)<4180>EV:HCDotNETServerManager::ServerManagerInvoke Method invoked=GetCurrentState hr=00000000
14215:46:37.729 (StorageServer)<4180>EV:HCDotNETServerManager::ThreadRoutine GetCurrentState ==> Running (hr=00000000)
14315:46:52.057 (JournalTask)<4264>EV~IThe Journal Task 'Journal Task for CHR419 J5' against CHR419 has started (6.0.2.7791) |
14415:47:01.214 (JournalTask)<5364>EV~WA Journal mailbox has a backlog of messages held in its Inbox. |Mailbox: SVCMAILJOURNAL5 |Messages Held: 206599 |Warning Threshold: 150000 |
14515:47:01.495 (JournalTask)<5364>EV~WThe number of items pending indexing for the archive has grown above the threshold limit. This Task will pause for 1 minute(s) to allow the backlog to clear. |Task: |Target: /O=C.H. ROBINSON COMPANY/OU=CHR/CN=RECIPIENTS/CN=SVCMAILJOURNAL5 |Archive Name: Mail Journal 5 |Archive Id: 1A8D74CA533A7A54D84D41B86579D9E5A1110000evaultchr |
14615:47:37.729 (StorageServer)<4180>EV:HCDotNETServerManager::ServerManagerInvoke Method invoked=GetCurrentState hr=00000000
14715:47:37.729 (StorageServer)<4180>EV:HCDotNETServerManager::ThreadRoutine GetCurrentState ==> Running (hr=00000000)
14815:48:03.479 (JournalTask)<5364>EV~WThe number of items pending indexing for the archive has grown above the threshold limit. This Task will pause for 1 minute(s) to allow the backlog to clear. |Task: |Target: /O=C.H. ROBINSON COMPANY/OU=CHR/CN=RECIPIENTS/CN=SVCMAILJOURNAL5 |Archive Name: Mail Journal 5 |Archive Id: 1A8D74CA533A7A54D84D41B86579D9E5A1110000evaultchr |
14915:48:37.729 (StorageServer)<4180>EV:HCDotNETServerManager::ServerManagerInvoke Method invoked=GetCurrentState hr=00000000
15015:48:37.729 (StorageServer)<4180>EV:HCDotNETServerManager::ThreadRoutine GetCurrentState ==> Running (hr=00000000)
15115:49:05.260 (JournalTask)<5364>EV~WThe number of items pending indexing for the archive has grown above the threshold limit. This Task will pause for 1 minute(s) to allow the backlog to clear. |Task: |Target: /O=C.H. ROBINSON COMPANY/OU=CHR/CN=RECIPIENTS/CN=SVCMAILJOURNAL5 |Archive Name: Mail Journal 5 |Archive Id: 1A8D74CA533A7A54D84D41B86579D9E5A1110000evaultchr |
15215:49:31.150 (StorageServer)<1968>EV:LCServiceModule::Handler (Entry) |
15315:49:31.150 (StorageServer)<1968>EV:LCServiceModule::Handler|Received SERVICE_CONTROL_INTERROGATE request from SCM
15415:49:31.150 (StorageServer)<1968>EV:MCServiceModule::Handler (Exit) |
15515:49:37.728 (StorageServer)<4180>EV:HCDotNETServerManager::ServerManagerInvoke Method invoked=GetCurrentState hr=00000000
15615:49:37.728 (StorageServer)<4180>EV:HCDotNETServerManager::ThreadRoutine GetCurrentState ==> Running (hr=00000000)
15715:50:37.728 (StorageServer)<4180>EV:HCDotNETServerManager::ServerManagerInvoke Method invoked=GetCurrentState hr=00000000
15815:50:37.728 (StorageServer)<4180>EV:HCDotNETServerManager::ThreadRoutine GetCurrentState ==> Running (hr=00000000)
15915:50:57.868 (JournalTask)<5364>EV~WThe number of items pending indexing for the archive has grown above the threshold limit. This Task will pause for 1 minute(s) to allow the backlog to clear. |Task: |Target: /O=C.H. ROBINSON COMPANY/OU=CHR/CN=RECIPIENTS/CN=SVCMAILJOURNAL5 |Archive Name: Mail Journal 5 |Archive Id: 1A8D74CA533A7A54D84D41B86579D9E5A1110000evaultchr |
16015:51:37.727 (StorageServer)<4180>EV:HCDotNETServerManager::ServerManagerInvoke Method invoked=GetCurrentState hr=00000000
16115:51:37.727 (StorageServer)<4180>EV:HCDotNETServerManager::ThreadRoutine GetCurrentState ==> Running (hr=00000000)
16215:52:31.586 (StorageServer)<1968>EV:LCServiceModule::Handler (Entry) |
16315:52:31.586 (StorageServer)<1968>EV:LCServiceModule::Handler|Received SERVICE_CONTROL_INTERROGATE request from SCM
16415:52:31.586 (StorageServer)<1968>EV:MCServiceModule::Handler (Exit) |
16515:52:37.727 (StorageServer)<4180>EV:HCDotNETServerManager::ServerManagerInvoke Method invoked=GetCurrentState hr=00000000
16615:52:37.727 (StorageServer)<4180>EV:HCDotNETServerManager::ThreadRoutine GetCurrentState ==> Running (hr=00000000)

[TonySterling]

try just tracing the journaltask and storagecrawler. Also, stop the other journal task while you trace.

[Chad_Petrie_2]

Here are the results of the dtrace:


DTrace trace log


Enabled Trace options

Id Name Detail Include Events
44 - JournalTask Verbose Yes
57 - StorageCrawler Verbose Yes

-----


Display Filter:
Include strings:
EV-
EV:
EV~

Exclude strings:
CMMStream
DBFramework
DirectoryConnection
DirectoryVault
-----


Running in Terminal Services session...
Monitoring debug output from processes running in the console session
Monitoring debug output from processes running in the current Terminal Services session

118:15:45.102 (JournalTask)<2880>EV:MAgentMessageDispenser: 5 of 5 Agent threads is resuming|
218:15:45.102 (JournalTask)<7112>EV:MAgentMessageDispenser: 4 of 5 Agent threads is resuming|
318:15:45.102 (JournalTask)<5364>EV:MAgentMessageDispenser: 2 of 5 Agent threads is resuming|
418:15:45.102 (JournalTask)<7328>EV:MAgentMessageDispenser: 3 of 5 Agent threads is resuming|
518:15:45.102 (JournalTask)<2880>EV:MAgentMessageDispenser::ResumeDispenserThread - Waiting for other Sleeping Threads to Wake
618:15:45.102 (JournalTask)<7112>EV:MAgentMessageDispenser::ResumeDispenserThread - Waiting for other Sleeping Threads to Wake
718:15:45.102 (JournalTask)<5364>EV:MAgentMessageDispenser::ResumeDispenserThread - Waiting for other Sleeping Threads to Wake
818:15:45.102 (JournalTask)<7328>EV:MAgentMessageDispenser::ResumeDispenserThread - Waiting for other Sleeping Threads to Wake
918:15:45.134 (JournalTask)<5096>EV:MAgentMessageDispenser: 1 of 5 Agent threads is resuming|
1018:15:45.134 (JournalTask)<5096>EV:MAgentMessageDispenser::LogResumeReason - Last Dispenser Thread to WakeUp
1118:15:45.134 (JournalTask)<5096>EV:M:AgentMessageDispenser::ProcessNextMessage() |Retrieved a message successfully from the queue |
1218:15:45.134 (JournalTask)<5096>EV:M:AgentMessageDispenser::ProcessNextMessage() |Read new message or a message that is within its retry limit (). |About to process the message body |
1318:15:45.134 (JournalTask)<5096>EV:H:AgentMessageDispenser::ActivateObject() |Entering routine |
1418:15:45.134 (JournalTask)<5096>EV:M:AgentMessageDispenser::ActivateObject() |Message type indicator = MsgID_ArchiveMailboxEx. |Will fall through to be handled by the case for MsgID_ArchiveMailboxExImp |
1518:15:45.134 (JournalTask)<5096>EV:M:AgentMessageDispenser::ActivateObject() |Message type indicator = MsgID_ArchiveMailboxExImp |
1618:15:45.134 (JournalTask)<5096>EV:L:AgentMessageDispenser::ActivateObject() |Called server side object, with arguments: |m_pIBackgroundArchivingAgent->ProcessUserEx(Priority = "true",| ReportingMode = "false",| ContinuousMode = "true",| RollOverLogFile = "false",| NumMsgsToArchivePerPass = "0",| legacyMessageStoreDn = "CHR419",| legacyMailboxDn = "/O=C.H. ROBINSON COMPANY/OU=CHR/CN=RECIPIENTS/CN=SVCMAILJOURNAL5",| adMessageStoreDn = "CN=Mailbox Store (CHR419),CN=First Storage Group,CN=InformationStore,CN=CHR419,CN=Servers,CN=CHR,CN=Administrative Groups,CN=CH Robinson Company,CN=Microsoft Exchange,CN=Services,CN=Configuration,DC=chrw,DC=com",| adMailboxDn = "CN=svcMailJournal5,OU=Utility Accounts,OU=IT,OU=Central Office,DC=chrobinson,DC=com"|, NULL);| |
1718:15:45.134 (JournalTask)<5096>EV:MCArchivingAgent::ProcessUserEx - JournalTaskList count
1818:15:45.134 (JournalTask)<5096>EV:MCArchivingAgent::ProcessUserEx() - JournalTarget list count = 1
1918:15:45.134 (JournalTask)<5096>EV:MEPC::GDP - Returning Default Policy :
2018:15:45.134 (JournalTask)<5096>EV:H:CArchivingAgent::ProcessUser() |Entering routine |
2118:15:45.134 (JournalTask)<5096>EV:MCMailboxUsage::SetMailboxInUse - Adding MbxDN to List:
2218:15:45.134 (JournalTask)<5096>EV:LCArchivingAgent::Initialise (Entry) |
2318:15:45.134 (JournalTask)<5096>EV:LCArchivingAgent::Initialise (Exit) |Success |
2418:15:45.134 (JournalTask)<5096>EV:H:CArchivingAgent::ProcessUser() |Getting a MAPI session from the session pool |
2518:15:45.134 (JournalTask)<5096>EV:MCMAPISession::GetMapiSessionFromPool(AdditionalFlags = 0)
2618:15:45.134 (JournalTask)<5096>EV:MCMAPISession::GetMapiSessionFromPool(): abandoning default system profile & session
2718:15:45.149 (JournalTask)<5096>EV:MCMAPISession::CloseMapiSession()->Logoff(): VaultMbxAgent-CHR419-5096-1144947689-637-0-0
2818:15:45.165 (JournalTask)<5096>EV:MCMAPISession::CreateMapiSession()
2918:15:45.165 (JournalTask)<5096>EV:MCMAPISession::CMS() - Calling CreateProfileAndSession
3018:15:45.165 (JournalTask)<5096>EV:MCMailboxHelper::CreateProfileAndSession(VaultMbxAgent-CHR419-5096-1144947689-637-0-0) - Profile successfully reused
3118:15:45.165 (JournalTask)<5096>EV:MCMailboxHelper::CreateProfileAndSession(VaultMbxAgent-CHR419-5096-1144947689-637-0-0) - Profile successfully created
3218:15:45.165 (JournalTask)<5096>EV:MCMAPISession::CMS() - Calling OpenMailbox
3318:15:45.165 (JournalTask)<5096>EV:MCMailboxHelper::OM() - GetMsgStoresTable
3418:15:45.165 (JournalTask)<5096>EV:MCMailboxHelper::OM() - HrQueryAllRows
3518:15:45.165 (JournalTask)<5096>EV:MCMailboxHelper::OM() - OpenMsgStore
3618:15:45.181 (JournalTask)<5096>EV:MCMAPISession::CMS() - Get PR_MAILBOX_OWNER_ENTRYID
3718:15:45.181 (JournalTask)<5096>EV:MCMAPISession::CMS() - OpenEntry(IMailUser)
3818:15:45.181 (JournalTask)<5096>EV:MCMAPISession::CMS() - Get PR_EMAIL_ADDRESS
3918:15:45.181 (JournalTask)<5096>EV:MCMAPISession::CMS() - Get IExchangeManageStore interface
4018:15:45.181 (JournalTask)<5096>EV:MCMAPISession::CMS() - Release Mutex(1)
4118:15:45.181 (JournalTask)<5096>EV:MCMAPISession::GetMapiSessionFromPool(): Exit status: 0x0
4218:15:45.181 (JournalTask)<5096>EV:MEPC::GP - Returning Policy :
4318:15:45.181 (JournalTask)<5096>EV:MCAA::GUP() - CN=svcMailJournal5,OU=Utility Accounts,OU=IT,OU=Central Office,DC=chrobinson,DC=com is using Policy : Default Exchange Journaling Policy
4418:15:45.181 (JournalTask)<5096>EV:H:CArchivingAgent::ProcessUser() |Creating the Entry ID of user mailbox to be processed |
4518:15:45.181 (JournalTask)<5096>EV:H:CArchivingAgent::ProcessUser() |Open users message store |
4618:15:45.181 (JournalTask)<5096>EV:H:CArchivingAgent::ProcessUser() |Getting the entry ID of the mailbox wastebasket or deleted items folder |
4718:15:45.181 (JournalTask)<5096>EV:MCFolderHelper::GSF() - Setting WASTEBASKET folder
4818:15:45.181 (JournalTask)<5096>EV:MCFolderHelper::GSF() - Setting OUTBOX folder
4918:15:45.181 (JournalTask)<5096>EV:MCFolderHelper::GSF() - Setting SENTITEMS folder
5018:15:45.181 (JournalTask)<5096>EV:MCFolderHelper::GSF() - Setting INBOX folder
5118:15:45.181 (JournalTask)<5096>EV:MCFolderHelper::GSF() - Setting CALENDAR folder
5218:15:45.181 (JournalTask)<5096>EV:MCFolderHelper::GSF() - Setting CONTACTS folder
5318:15:45.181 (JournalTask)<5096>EV:MCFolderHelper::GSF() - Setting DRAFTS folder
5418:15:45.181 (JournalTask)<5096>EV:MCFolderHelper::GSF() - Setting JOURNAL folder
5518:15:45.181 (JournalTask)<5096>EV:MCFolderHelper::GSF() - Setting NOTES folder
5618:15:45.181 (JournalTask)<5096>EV:MCFolderHelper::GSF() - Setting TASKS folder
5718:15:45.181 (JournalTask)<5096>EV:H:CArchivingAgent::ProcessUser() |Getting the users mailbox folder and state. |
5818:15:45.181 (JournalTask)<5096>EV:MCMailboxHelper::GetMailboxState - Mailbox state is Enabled
5918:15:45.181 (JournalTask)<5096>EV:MCMailboxHelper::GetMailboxState - Journal Mailbox
6018:15:45.196 (JournalTask)<5096>EV:M:CArchivingAgent::ProcessUser_EnableHandling() - Entering routine
6118:15:45.196 (JournalTask)<5096>EV:M:CArchivingAgent::ProcessUser_EnableHandling() - Exiting routine successfully
6218:15:45.212 (JournalTask)<7328>EV:MAgentMessageDispenser::ResumeDispenserThread - Thread awake
6318:15:45.212 (JournalTask)<7112>EV:MAgentMessageDispenser::ResumeDispenserThread - Thread awake
6418:15:45.212 (JournalTask)<5364>EV:MAgentMessageDispenser::ResumeDispenserThread - Thread awake
6518:15:45.212 (JournalTask)<2880>EV:MAgentMessageDispenser::ResumeDispenserThread - Thread awake
6618:15:45.384 (JournalTask)<5096>EV:H:CArchivingAgent::ProcessUser() |Reading users quota limit and current usage |
6718:15:45.399 (JournalTask)<5096>EV:HA storage limit has been found on mailbox CN=svcMailJournal5,OU=Utility Accounts,OU=IT,OU=Central Office,DC=chrobinson,DC=com| Quota Type: QUOTA_NONE| Quota Limit (K): 2088841744| Quota Used (K): 4194303| (Note: This is the information store default for all mailboxes) |
6818:15:45.399 (JournalTask)<5096>EV:H:CArchivingAgent::ProcessUser() |We are the Journal agent. Marking the this mailbox as the Journal mailbox |
7018:15:45.665 (JournalTask)<5096>EV:MCBaseDirectoryServiceWrapper::CreateDirectoryService(): Local directory service is running
7118:15:45.665 (JournalTask)<5096>EV:MCBaseDirectoryServiceWrapper::CreateDirectoryService(): Using local directory connection
7218:15:45.665 (JournalTask)<5096>EV:H:CArchivingAgent::ProcessUser() |We have an enabled mailbox that is ready for processing. |
7318:15:45.665 (JournalTask)<5096>EV:MMAPICommon::GetFixed_PR_FOLDER_PATHNAME() - Reading PR_FOLDER_PATHNAME
7418:15:45.665 (JournalTask)<5096>EV:MMAPICommon::GetFixed_PR_FOLDER_PATHNAME() - The source folder is the root of the information store, returning an empty string
7518:15:45.665 (JournalTask)<5096>EV:MMAPICommon::GetFixed_PR_FOLDER_PATHNAME() - Setting output parameter
7618:15:45.681 (JournalTask)<5096>EV:MCFolderHelper::GFS(Top of Information Store/(null)) - The archiveVEID has changed from the previous folder
7818:15:45.681 (JournalTask)<5096>EV:MCBaseDirectoryServiceWrapper::CreateDirectoryService(): Local directory service is running
7918:15:45.681 (JournalTask)<5096>EV:MCBaseDirectoryServiceWrapper::CreateDirectoryService(): Using local directory connection
9818:15:45.696 (JournalTask)<5096>EV:MCFolderHelper::GFS(Top of Information Store) Non-Structured archive - nothing to do
9918:15:45.696 (JournalTask)<5096>EV:MCMailboxHelper::GetDefaultVaultId() - returning value 1A8D74CA533A7A54D84D41B86579D9E5A1110000evaultchr
10018:15:45.696 (JournalTask)<5096>EV:MCAA::PUEX() - Mailbox Folder Policy : Using users default policy
10118:15:45.696 (JournalTask)<5096>EV:H:CArchivingAgent::ProcessUser() |Processing all the sub folders of the current folder |
10218:15:45.696 (JournalTask)<5096>EV:H:CArchivingAgent::ProcessFolders() |Entering routine |
10318:15:45.696 (JournalTask)<5096>EV:H:CArchivingAgent::PF_SetFilterAndRentention() |Entering routine |
10418:15:45.696 (JournalTask)<5096>EV:MMAPICommon::GetFixed_PR_FOLDER_PATHNAME() - Reading PR_FOLDER_PATHNAME
10518:15:45.696 (JournalTask)<5096>EV:MMAPICommon::GetFixed_PR_FOLDER_PATHNAME() - The source folder is the root of the information store, returning an empty string
10618:15:45.696 (JournalTask)<5096>EV:MMAPICommon::GetFixed_PR_FOLDER_PATHNAME() - Setting output parameter
10718:15:45.696 (JournalTask)<5096>EV:MCFolderHelper::GFS(Top of Information Store) - Current folder is using parent folder archiveVEID

[Jason_Sylvest1]

I am running EV6.0 SP1, and I've seen this event on every single one of my journal servers. The Index Pending count is number of items the Index Service is waiting to commit -- do this query on your SQL server from the database for that vault store:

SELECT count(*)
FROM JournalArchive

and you will see how many items are pending. Has nothing to do with the number of messages in the mailbox, I've see it happen when there are thousands or millions of messages in the journal mailbox, or when there are just a couple hundred.

My personal experience is that there is no way to avoid these warnings, at some point the index services will just hit the threshold and then do the 1 minute pauses for a period of tiem until the Index service can catch up and drop the number of items below the threshold. Then the process will repeat a short while later.

But there are a few registry keys you coudl tinker with to see if you can avoid hitting the threshold - with the warning that in my experiences these settings did not have any effect on this behavior...

HKEY_LOCAL_MACHINE\Software\KVS\Enterprise Vault\Storage
IndexBacklog (DWORD)
DWORD
Value: 30000
default is 10,000. This is the threshold that is referred to by the warning. When the journal task runs, it checks to see if the item count pending is above this number, if not it will run a full cycle. (So the actual count can go well above whatever value is set here before the current cycle ends).

I did find the resolved issues on production journal tasks that were showing this warning, after applying this setting they did not re-occur.

HKEY_LOCAL_MACHINE\Software\KVS\Enterprise Vault\Indexing
NumWordsToWrite (DWORD)
DWORD
Value: 10000000
default is 2,000,000.
My notes read "Part of the issue with Indexing pausing deals with compaction. When Index Compaction occurs, we have to wait until that compaction process completes until the Index can be updated again."
I tested this setting a half default, double default, and the 10,000,000 setting recommended, I didn't see any significant change in performance levels.

HKEY_LOCAL_MACHINE\Software\KVS\Enterprise Vault\Indexing
CacheReloadTimeout (DWORD)
DWORD
Value: 3
My notes read "An explanation of the registry key is that we check the journal archive cache to see if we have hit the threshold (of 10000 items not commited to the Index) and then sleep for 5 minutes. However, because this cache only gets updated every 20 minutes by default, you can be in a situation where the cache shows that we are over the threshold when in fact we are not and so we can sleep for 5 minutes up to 3 or 4 times before we start processing again. Setting this regkey to a lower value, avoids this situation. Setting this value to 3 appears to be the optimal setting."
Again, my testing with a number of journal servers resulted in no noticeable change in performance levels.

My end solution was to simply endure the various periods of the pause messages through the day and to adjust downward the expected throughput levels. But my case is a bit strange due to the amount of data and the timeframe I am coping with as we populate the vault stores.


*** Standard disclaimers regarding the editing of registry settings apply ***

[Micah_Wyenn_2]

kewl performance tuning suggestions tho...thanks for the notes. You should post another entry on the successes you've had (or haven't had).

micah

[Michael_Bilsbor]

Hi.
As a person who actually understand all those reg keys (and I'll admit this event was kind of my idea...) then I can say that IndexBacklog is the only one you need to set. You can get into a situation where journalling is sleeping and doesn't nudge indexing to go ahead and tidy up records in journalarchive.

[Chad_Petrie_2]

I do not see any of the reg keys listed on any of my servers. I do have:


KKEY_Local_Machine\software\kvs\enterprise vault\storage
X_MonitorPendingIndexing
which is set to 30000

[W_Wintermute · Accepted solution]

The IndexBacklog regkey has replaced MonitorPendingIndexing

During one of the EV upgrades (I think it was 5.0 SP3) an X_ gets placed in front
of MonitorPendingIndexing. That regkey doesn't do anything anymore.

So if you want to try this, you would add the following regkey and see if that
reduces your pauses.

HKEY_LOCAL_MACHINE\Software\KVS\Enterprise Vault\Storage
IndexBacklog (DWORD)
DWORD
Value: 30000

[Chad_Petrie_2]

Thanks for your help guys! I finally see messages starting to archive. Adding the reg key got the box to start messages flowing.