High amount of backlog on Indexer
My client has an indexer that has over 30GB in backlog audit files located in the inbox. I have done some digging and found the commd0.0err log, this shows numerous errors. These errors range from "files could not be consumed in batch mode", to "report execution failed" to "status update failed to config. None or more than one migration running for device" Until recently this indexer had over 70 filers attached to it. That number has been reduced to 50, but the backlog has failed to diminish.Solved654Views4likes1CommentData Insight - backlogged files
We are running Data Insight 4.5, with multiple indexer/collectors doing file scans and Fpolicy across nearly 2 dozen netapps. Is there a 'best method' to address the lag between an event occurring (such as a file being deleted from a filer) and when the event shows up in Data Insight? We are running our indexers/preprocessors at 30min, but our file backlock for most things remains over an hour. We are not hitting much utilization on our collectors (averaging 3% cpu utilization and 40% memory on 64bit 12gb ram 8-core server2008r2). On the performance section, the backlog size is generally 30-100 files, 10mb-20mb.Solved1.4KViews3likes3CommentsDQL Report does not output to 1 file 5.0.1
I am using DI 5.0.1 and I am not able to have the DQL report to output to 1 single file. Is anyone else having this issue? I have a DQL query and when I am pulling some of the AD Attributes, it will separate the files. I even have put 'format user AS csv' at the end and it still puts it into multiple files. From user get name, principal_name, login, Home_directory, Department If Home_Directory not in ('nowhere') format user AS CSV; Please help!3.2KViews1like3Commentsdashboard.db
How does the process gather data. "My client is asking how does a server decide which indexer to draw info from?" We have found older dashboard.db files in updates folder on all of their deployed indexers. How does the process work from processors to management server?512Views1like0CommentsDI configuration modification
Is it possible to modify the configuration of the DI environment to monitor filers in a cluster as individual servers? Large environment with DFS clusters, needing to monitor the servers in the clusters as individual servers to allow Data at Rest to use the DI information for share size.Solved1KViews1like3CommentsData Insight - max results issue
When running reports in Data Insight, we need to expand the number of results in the reports. In another site, Data Insight is configured to have about 99999999999 counts before truncation, because a Conf file was able to be edited. No one recorded what that file was or where, so we can't duplicate this on the new site. This is the portion of the reports we want to increase past the standard limit. "Truncate output if record count exceeds:" Does anyone know the config file I'm referring to, or where it is located?Solved1.3KViews1like3CommentsDQL: Sum the Sum of Total Access, Exporting Dashboards
Is there a way to use DQL to demonstrate the sum of the sum of total access for sites? For example, you can generate reports to showthe number of people with access levels ofcreate, read, write, and delete per site, but can you also demonstrate that total per person? We are looking to determine an individual's level of access to each site monitored by DI, summed per level of access. In addition to this, can you export the graphs and dashboards generated to Excel? You can save the raw data in table format, but the graphs would also be helpful. Thanks! Evan1.9KViews1like8CommentsSpeeding up console
Is there any configuration changes we can make on the server side to speed up the console such as browsing the workspace? Browsing the workspace is pretty slow such as getting audit data or just getting permission info. The server is not running low on memory or CPU. We're running DI 4.0.Solved2.4KViews1like2CommentsData Insight for Sharepoint upgrade - 4.0.1 failed
Working with a client now on upgrading their DataInsight production servers. The Manager, Collector/indexer upgrades including about 20 agents were all successfull. Moving to upgrade the Sharepoint farm per documenation we uninstalled 4.0 and ran the installer for 4.01 and it failed. We used the same procedures (with exception to uninstalling DI 4.0) and Admin account to install DI 4.0 just a month ago and did so successfully. Below is the error log followed by our installation procedures. Any assistance would be appreciated. I will only include where the errors in the log begin as its a large log (The complete log is attached). It seems an issue with JRE JRE is packed Unpacking JRE jre\bin\unpack200.exe -r "jre\lib\rt.jar.pack" "jre\lib\rt.jar" waiting for unpack200 to finish unpack done pack path doesn't exists jre\bin\unpack200.exe -r "jre\lib\charsets.jar.pack" "jre\lib\charsets.jar" waiting for unpack200 to finish unpack done jre\bin\unpack200.exe -r "jre\lib\plugin.jar.pack" "jre\lib\plugin.jar" waiting for unpack200 to finish unpack done jre\bin\unpack200.exe -r "jre\lib\deploy.jar.pack" "jre\lib\deploy.jar" waiting for unpack200 to finish unpack done jre\bin\unpack200.exe -r "jre\lib\ext\localedata.jar.pack" "jre\lib\ext\localedata.jar" waiting for unpack200 to finish unpack done jre\bin\unpack200.exe -r "jre\lib\jsse.jar.pack" "jre\lib\jsse.jar" waiting for unpack200 to finish unpack done Unpacking JRE done JRE dir: C:\Users\SVC_SH~1\AppData\Local\Temp\5\e4j8C51.tmp_dir1382985889\jre LoadDLL (0, C:\Users\SVC_SH~1\AppData\Local\Temp\5\e4j8C51.tmp_dir1382985889\jre, 0) Got JRE location C:\Users\SVC_SH~1\AppData\Local\Temp\5\e4j8C51.tmp_dir1382985889\jre (java exe: 0) MinVersion: 1.6, MaxVersion: Trying to load JVM-DLL from c:\users\svc_sh~1\appdata\local\temp\5\e4j8c51.tmp_dir1382985889\jre\bin\java.exe Setting PATH C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Program Files (x86)\Windows Imaging\;e:\Program Files (x86)\Smart Projects\IsoBuster;c:\users\svc_sh~1\appdata\local\temp\5\e4j8c51.tmp_dir1382985889\jre\bin Trying c:\users\svc_sh~1\appdata\local\temp\5\e4j8c51.tmp_dir1382985889\jre\bin\hotspot\jvm.dll (exists 0) Trying c:\users\svc_sh~1\appdata\local\temp\5\e4j8c51.tmp_dir1382985889\jre\bin\client\jvm.dll (exists 1) Failed with error code 2 Trying c:\users\svc_sh~1\appdata\local\temp\5\e4j8c51.tmp_dir1382985889\jre\bin\server\jvm.dll (exists 0) Trying c:\users\svc_sh~1\appdata\local\temp\5\e4j8c51.tmp_dir1382985889\jre\bin\classic\jvm.dll (exists 0) Trying c:\users\svc_sh~1\appdata\local\temp\5\e4j8c51.tmp_dir1382985889\jre\bin\jrockit\jvm.dll (exists 0) Setting PATH C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Program Files (x86)\Windows Imaging\;e:\Program Files (x86)\Smart Projects\IsoBuster Setting PATH C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Program Files (x86)\Windows Imaging\;e:\Program Files (x86)\Smart Projects\IsoBuster;c:\users\svc_sh~1\appdata\local\temp\5\e4j8c51.tmp_dir1382985889\jre\bin\..\jre\bin Trying c:\users\svc_sh~1\appdata\local\temp\5\e4j8c51.tmp_dir1382985889\jre\bin\..\jre\bin\hotspot\jvm.dll (exists 0) Trying c:\users\svc_sh~1\appdata\local\temp\5\e4j8c51.tmp_dir1382985889\jre\bin\..\jre\bin\client\jvm.dll (exists 0) Trying c:\users\svc_sh~1\appdata\local\temp\5\e4j8c51.tmp_dir1382985889\jre\bin\..\jre\bin\server\jvm.dll (exists 0) Trying c:\users\svc_sh~1\appdata\local\temp\5\e4j8c51.tmp_dir1382985889\jre\bin\..\jre\bin\classic\jvm.dll (exists 0) Trying c:\users\svc_sh~1\appdata\local\temp\5\e4j8c51.tmp_dir1382985889\jre\bin\..\jre\bin\jrockit\jvm.dll (exists 0) Setting PATH C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Program Files (x86)\Windows Imaging\;e:\Program Files (x86)\Smart Projects\IsoBuster ERROR: Could not get DLL-Handle. ERROR: Could not load functions ERROR: Could not load bundled JRE. Trying to find another JRE. LoadDLL (0, (null), 0) Searching for a JVM GetTempPath returned 39 (last error 3) make dir returned -1 Testing location .\jre (type B) checkJavaExe (\\tsclient\c\sharepoint_agent_data_insight_4.0rp1\jre\bin\java.exe, [out], 1.6, , 1) file doesn't exist checkJavaExe returning 0 GetTempPath returned 39 (last error 183) make dir returned -1 Testing location .\jre (type R) checkJavaExe (\\tsclient\c\sharepoint_agent_data_insight_4.0rp1\jre\bin\java.exe, [out], 1.6, , 1) file doesn't exist checkJavaExe returning 0 GetTempPath returned 39 (last error 183) make dir returned -1 Testing location (type Y) GetTempPath returned 39 (last error 183) make dir returned -1 Testing location JAVA_HOME (type E) GetTempPath returned 39 (last error 203) make dir returned -1 Testing location JDK_HOME (type E) Testing relative location .\jre Search sequence finished ERROR: No JVM found ERROR: Could not find another JRE. Here is our Sharepoint 2010 installation procedure: 1. Logon to the SharePoint farm machine where the SharePoint agent has been previously installed. 2. Uninstall the old agent using the "Add/Remove Programs" applet in the Control Panel. 3. Unzip the patch files to a temporary folder. In this folder, locate the SharePoint agent installer. The installer is called either: Symantec_DataInsight_sharepoint2010_40RP1_4_0_0_4007.exe 4. Launch the installer to install the new agent. Verify the installation: In the Central Administration console, click the Sytsem Settings. Under the Farm Management page, select Manage Farm Solutions. Verify that the status for Data Insight solution for SharePoint, sdispwebsvc.wsp, is set to Deployed. Click the link for the solution. Verify that the solution is deployed to all the front-end Web servers in the farm by checking the value of “DeployedTo” field.Solved1.3KViews1like1Comment