High CPU utilization due to many BPBKAR process
Hi All, I havea query, Today found a server in which CPU utilization was high upto 95%. When checked on the server, found many BPBKAR process were running there. That was obvious because backup for that server running, Is there a way we can minimize CPU utilization while "BPBKAR" process and backup keep running ? Means without affecting backup, can we make CPU utilization normal. Please advice and suggest...Solved16KViews1like6CommentsJobs in queued state: Waiting in NetBackup scheduler work queue on server :
Hello Everybody, We are seeing this all the jobs. I have checked other threads related to same problem but none of them helped. Nothing is moving in the environment, almost every backup is failing with 196 after staying in queued state. We opened a severity one case with support they are asking to increase the memory, we have ordered the new memory. But I am seeing no sighns that server is running out of memory or something like that. Anytime there is nearly 3 GB available of physical memory. Below is the output from one job. 8/22/2014 9:32:39 AM - Info nbjm(pid=12846) Waiting in NetBackup scheduler work queue on server 8/22/2014 9:34:41 AM - Info nbjm(pid=12846) Waiting in NetBackup scheduler work queue on server 8/22/2014 9:36:41 AM - Info nbjm(pid=12846) Waiting in NetBackup scheduler work queue on server 8/22/2014 9:38:41 AM - Info nbjm(pid=12846) Waiting in NetBackup scheduler work queue on server 8/22/2014 9:40:41 AM - Info nbjm(pid=12846) Waiting in NetBackup scheduler work queue on server 8/22/2014 9:42:41 AM - Info nbjm(pid=12846) Waiting in NetBackup scheduler work queue on server 8/22/2014 9:44:41 AM - Info nbjm(pid=12846) Waiting in NetBackup scheduler work queue on server 8/22/2014 9:46:41 AM - Info nbjm(pid=12846) Waiting in NetBackup scheduler work queue on server Secondly I tried this command as given in another thread just to check the scheduler queue but no use. nbpemreq -jobs screen all Maximum output size exceeded, see log We have already tried restarting the NBU, rebooting the master server but this things creeeps up every time. Everything is so slow now. If we triggering a job using bpbackup it takes good 20 minutes to show up in activity monitor. Tapes drives are free but still NBU is not able to assign them for the waiting job and those jobs are just waiting for the drives to continue. I am not sure which logs to provide. Let me know which logs and what other info is needed to look into this. Environment info: NBU 7.5.0.5 running on Solaris 10 20+ media server sharing same DD and Tape library SLP Duplication is used12KViews1like23CommentsMIssing PATH: for drives
I ahve a LINUX Media server, and the drive path when i run a tpconfig shows missing. How do I get NB to see the paths once again? Enter option: Id DriveName Type Residence Drive Path Status **************************************************************************** 1 Sep1-71 hcart2 TLD(3) DRIVE=71 MISSING_PATH:4:0:0:2:SG11029122 DOWN 2 Sep1-70 hcart2 TLD(3) DRIVE=70 MISSING_PATH:4:0:0:1:SG11029121 DOWN 3 Sep1-84 hcart2 TLD(3) DRIVE=84 MISSING_PATH:2:0:0:3:SG11029135 UP 4 Sep1-83 hcart2 TLD(3) DRIVE=83 MISSING_PATH:2:0:0:2:SG11029134 UP 5 Sep1-82 hcart2 TLD(3) DRIVE=82 MISSING_PATH:2:0:0:1:SG11029133 DOWN 6 Sep1-69 hcart2 TLD(3) DRIVE=69 MISSING_PATH:4:0:0:0:SG11029120 DOWN 7 Sep1-81 hcart2 TLD(3) DRIVE=81 MISSING_PATH:2:0:0:0:SG11029132 DOWN Currently defined robotics are: TLD(3) robot control host = nbuf1a EMM Server = nbuf1aSolved12KViews1like6CommentsVirtual Machines going out of network during snapshot backup
Has anyone experienced the Virtual machines going out of network during the backup using "VMware" policy. Apparently , the Windows VMs losing connectivity for a little while and coming back online and the Linux VMs becoming unresponsive.Solved12KViews1like7Commentsbpbkar waited xxxx times for empty buffer, delayed xxxx times
Hello, I am getting detailed report as below; and the network KB per second is down 3762 from original 42399. Any idea? 03/09/2013 03:00:00 - granted resource DAILY1 03/09/2013 03:00:00 - granted resource HP.ULTRIUM4-SCSI.000 03/09/2013 03:00:00 - granted resource ajva5000-hcart-robot-tld-0 03/09/2013 03:00:00 - estimated 494449958 kbytes needed 03/09/2013 03:00:00 - Info nbjm (pid=960) started backup job for client ajva5000, policy m5000, schedule Daily-Differential-Inc on storage unit ajva5000-hcart-robot-tld-0 03/09/2013 03:00:01 - Info bpbrm (pid=27395) ajva5000 is the host to backup data from 03/09/2013 03:00:01 - Info bpbrm (pid=27395) reading file list from client 03/09/2013 03:00:01 - Info bpbrm (pid=27395) starting bpbkar on client 03/09/2013 03:00:01 - Info bpbkar (pid=27399) Backup started 03/09/2013 03:00:01 - Info bpbrm (pid=27395) bptm pid: 27400 03/09/2013 03:00:01 - Info bptm (pid=27400) start 03/09/2013 03:00:01 - started process bpbrm (pid=27395) 03/09/2013 03:00:01 - connecting 03/09/2013 03:00:01 - connected; connect time: 0:00:00 03/09/2013 03:00:02 - Info bptm (pid=27400) using 65536 data buffer size 03/09/2013 03:00:02 - Info bptm (pid=27400) using 30 data buffers 03/09/2013 03:00:02 - Info bptm (pid=27400) start backup 03/09/2013 03:00:02 - Info bptm (pid=27400) Waiting for mount of media id DAILY1 (copy 1) on server ajva5000. 03/09/2013 03:00:02 - mounting DAILY1 03/09/2013 03:00:56 - Info bptm (pid=27400) media id DAILY1 mounted on drive index 0, drivepath /dev/rmt/0cbn, drivename HP.ULTRIUM4-SCSI.000, copy 1 03/09/2013 03:00:56 - mounted DAILY1; mount time: 0:00:54 03/09/2013 03:00:57 - positioning DAILY1 to file 25 03/09/2013 03:02:39 - positioned DAILY1; position time: 0:01:42 03/09/2013 03:02:39 - begin writing 03/09/2013 12:13:40 - Info bpbkar (pid=27399) bpbkar waited 1219344 times for empty buffer, delayed 1219737 times 03/09/2013 12:13:40 - Info bptm (pid=27400) waited for full buffer 447 times, delayed 16121 times 03/09/2013 12:13:49 - Info bptm (pid=27400) EXITING with status 0 <---------- 03/09/2013 12:13:49 - Info bpbrm (pid=27395) validating image for client ajva5000 03/09/2013 12:13:50 - Info bpbkar (pid=27399) done. status: 0: the requested operation was successfully completed 03/09/2013 12:13:50 - end writing; write time: 9:11:11 the requested operation was successfully completed (0) Prior to this; I got an error message in /var/adm/messages Mar 8 23:01:15 ajva5000 scsi: [ID 107833 kern.warning] WARNING: /pci@2,600000/pci@0/scsi@8 (mpt1): Mar 8 23:01:15 ajva5000 Connected command timeout for Target 4. Mar 8 23:01:15 ajva5000 scsi: [ID 107833 kern.warning] WARNING: /pci@2,600000/pci@0/scsi@8 (mpt1): Mar 8 23:01:15 ajva5000 Target 4 reverting to async. mode Mar 8 23:01:15 ajva5000 mpt: [ID 675377 kern.warning] WARNING: ID[SUNWpd.mpt.sync_wide_backoff.6013]Solved11KViews1like11CommentsBest practice “Maximum I/O streams per volume” with Disk Pools
My backups are failed with below error - awaiting resource CSD-SYD-STU-PD Reason: Maximum I/O stream count has been reached for disk volume, Media Server: ABC1257, Robot Number: NONE, Robot Type: NONE, Media ID: N/A, Drive Name: N/A, Volume Pool: CSD-SYD, Storage Unit: CSD-SYD-STU-PD, Drive Scan Host: N/A Limit has been reached for the logical resource csd-nbumaster.NBU_POLICY.MAXJOBS.CSD-SYD-CA client backup was not attempted because backup window closed(196) Environment: Netbackup 7.6.0.2& Windows Server 2008. Current Setting : Limit I/O streams = 32 per volume Maximum concurrent jobs=32 Maximum fragment size=51200 MBSolved10KViews1like5CommentsVery Slow VM Backups
Hi, We are currently using Network based VM backups rather than SAN based, the Backup Host is a Windows 2008 server running NBU7.5.0.5 and has full access to the ESX servers, I have several policies set up including VIP's for covering the VM's. The back bone is a 1Gb LAN, the Backup Host is SAN attached to an HP VLS12000 which is emulating LTO4 drives, this is on 4Gb F/C When backing up the VM's I am only seeing on average 1.5M/s throughput, we have standard clients that are using the conventional NBU method whuch reach over 40M/s through the same medium. Just wondered if there were any tuning or other paramaters that we need to look at with the VM backups to speed them up. KevSolved9.7KViews1like22CommentsDifference between Retention preiod and Rentention level
Hi In netbackup linux file level back up policy i noticed in scheudled tab retion period is 1 year and retention level is 5. i understand Retention preiod is to hold backup upto 1 year and i would like to know here what is retention level and why we need this. Thanks in advanceSolved8.8KViews1like4CommentsNetBackup Status Code 24 - Possible Parameters to Check
Hi Friends Receiving Status Code 24 is now becaming very common in our Infrastructure, where we are backing up alomost 7000 boxes using 10 different master servers. I agree there is a Technote Available from Symantec : http://www.symantec.com/business/support/index?page=content&id=HOWTO50801 for troubleshooting Status Code 24 Failures, but most of the time we are getting the situation where this is not enough to fix the issues. Can someone please help me to understand that what are the parameters need to be checked in Client / Media / Master server and the tuning can be made to fix the issue. Also is there any tool is avaiable to determine the root cause of the Status 24 Failure. Help would be highly appriciatedSolved8.3KViews1like7Comments