BE 2010 R3 backup jobs stuck in QUEUED statusafter Hotfix 178798

[Kris_ten_Hoedt]

Hiya all,

Last weekend Hotfix 178798 got automatically applied to our BE 2010 R3 server.

Since then backup to any media sits stuck in Queued status.
Even for a 1 file backup to local disk.
It doesn't even matter where the files originate from, if the backup is to disk or tape, it will do the following:

- pre-processing
- snapshot-processing
- queued

And it stays in this state forever. I have uninstalled the hotfix, reinstalled BE from scratch, but nothing seems to change. 
Getting realy desperate now, especially since Symantec is taking forever to create me an account so I can start a tech problem case.

Any help would be greatly appreciated!

Thanks!

Kris

[AmolB]

Do you see any unattended alerts in the alerts tab of Backup Exec console.

Any events generated in the Windows Event Viewer.

[Kris_ten_Hoedt]

Nothing out of the ordinary....

[Kris_ten_Hoedt]

I just started an old backup job, containing only SQL databases,  and it starts and runs.

Any other backup job still gets stuck in Queued status......

[VJware]

I don't recall any HF numbered 178798....Are you referring to SP2 ? If yes, as a test, un-install the SP & see if backups still get queued or not...

[Kris_ten_Hoedt]

Yes, I think so. In the BE logs it is referred as HF 178798, but I think we're talking about the same.

Already tried uninstalling it. Event tried re-installing BE all together.

[VJware]

ensure "Hold Job Queue" is not checked

Are all backups going into a queued status ? local and remote ?

have you tried creating a new B2D folder with appropriate rights ?

Any errors in the event viewer ?

[Kris_ten_Hoedt]

Hold Job Queue is not checked.

All backups, except for the old test job go into queued status.

Tried new b2d, something gets written in it initially, but the job remains queued just the same.

No errors in the eventviewer.

Also, the queued job can't be cancelled. I have to restart the BE services to force it to stop.
Last time I left it queued for over 14 hours, hoping it would run sometime. It didn't....

[VJware]

Check if there is a .lck file in the B2D folder or not....if there is, stop the BE services, delete that file, restart the services & re-attempt the backup

[Kris_ten_Hoedt]

No .lck files anywhere....

Please note that I started an old backup job (to tape) last night that ran without a single problem.
Over 400GB got written to tape.

And yes, I tried making a copy of that job. :)

The copied job won't run....

[VJware]

Have you tried repairing the BEDB database ?

[Kris_ten_Hoedt]

Nope... once I figured out how that's accomplished I'll report back here...

[VJware]

Use this KB for the repair - http://www.symantec.com/docs/TECH145645

[Kris_ten_Hoedt]

Did a consistancy check, came out fine.

Did a repair anyway, just to be sure.... no change.

I also ran the BE support tool, no issues there.

[Kris_ten_Hoedt]

Disabled AOFO, now the job runs!

pfffttt... should have checked that in the first place LOL

OK. New topic: BU jobs stays Queued when AOFO is enabled

[VJware · Accepted solution]

Retry a backup with AOFO enabled...if it gets queued, end the process vssvc.exe from the task mgr & re-try

And choose Microsoft Volume Shadow Copy service as the snapshot provider

[Kris_ten_Hoedt]

Guess what? It works! well for now anyways...

I stopped the VSC service (vssvc.exe) which is set to run on demand.

Then retried the backup and presto!

I'll leave it running untill it finishes by itself (I do need a backup now!) and report back here in about 10 hours.

Thanks!