CIFS Job stuck at 1024 bytes....

systematic92 · ‎05-14-2013

Anyone come across this before please?

Backing up CIFS data using NDMP from a NetApp device using a BEXEC Server that is 2010 R3 with latest patches:

When the job runs at its scheduled time (out of hours) it completes fine however, if we try to manually kick the job off at any other time, it just hangs on 1024 bytes. I don't think the times matter. I ran the debug tool and this is what I get: (just recycles the same info)

We do not have a central administration server.

MONITORI: [05/14/13 11:01:08] [0000] Script 'MOM Backward Compatibility Service State Monitoring Script' completed with the following output: (empty)

BENGINE: [05/14/13 11:01:11] [0000] 05/14/13 11:01:11 [ndmp\ndmpcomm] - ndmpSendRequest: message:0x400

BENGINE: [05/14/13 11:01:11] [0000] 05/14/13 11:01:11 [ndmp\ndmpcomm] - ndmp_writeit: len:28

BENGINE: [05/14/13 11:01:11] [0000] 05/14/13 11:01:11 [ndmp\ndmpcomm] - sent seq#: 381 msg: 0x400

BENGINE: [05/14/13 11:01:11] [0000] 05/14/13 11:01:11 [ndmp\ndmpcomm] - ndmp_process_messages: reply_expected:TRUE

BENGINE: [05/14/13 11:01:11] [0000] 05/14/13 11:01:11 [ndmp\ndmpcomm] - ndmp_recv_msg

BENGINE: [05/14/13 11:01:11] [0000] 05/14/13 11:01:11 [ndmp\ndmpcomm] - ndmp_readit: len:4000

BENGINE: [05/14/13 11:01:11] [0000] 05/14/13 11:01:11 [ndmp\ndmpcomm] - got expected reply msg: 0x400

BENGINE: [05/14/13 11:01:11] [0000] 05/14/13 11:01:11 [ndmp\ndmpcomm] - ndmp_process_messages: no more messages in stream buffer

BENGINE: [05/14/13 11:01:11] [0000] 05/14/13 11:01:11 [ndmp\ndmpcomm] - ndmpFreeMessage: message:0x400

BENGINE: [05/14/13 11:01:16] [0000] 05/14/13 11:01:16 [ndmp\ndmpcomm] - ndmpSendRequest: message:0x400

BENGINE: [05/14/13 11:01:16] [0000] 05/14/13 11:01:16 [ndmp\ndmpcomm] - ndmp_writeit: len:28

BENGINE: [05/14/13 11:01:17] [0000] 05/14/13 11:01:16 [ndmp\ndmpcomm] - sent seq#: 382 msg: 0x400

BENGINE: [05/14/13 11:01:17] [0000] 05/14/13 11:01:16 [ndmp\ndmpcomm] - ndmp_process_messages: reply_expected:TRUE

BENGINE: [05/14/13 11:01:17] [0000] 05/14/13 11:01:16 [ndmp\ndmpcomm] - ndmp_recv_msg

BENGINE: [05/14/13 11:01:17] [0000] 05/14/13 11:01:16 [ndmp\ndmpcomm] - ndmp_readit: len:4000

BENGINE: [05/14/13 11:01:17] [0000] 05/14/13 11:01:16 [ndmp\ndmpcomm] - got expected reply msg: 0x400

BENGINE: [05/14/13 11:01:17] [0000] 05/14/13 11:01:16 [ndmp\ndmpcomm] - ndmp_process_messages: no more messages in stream buffer

BENGINE: [05/14/13 11:01:17] [0000] 05/14/13 11:01:16 [ndmp\ndmpcomm] - ndmpFreeMessage: message:0x400

BENGINE: [05/14/13 11:01:22] [0000] 05/14/13 11:01:21 [ndmp\ndmpcomm] - ndmpSendRequest: message:0x400

BENGINE: [05/14/13 11:01:22] [0000] 05/14/13 11:01:21 [ndmp\ndmpcomm] - ndmp_writeit: len:28

BENGINE: [05/14/13 11:01:22] [0000] 05/14/13 11:01:21 [ndmp\ndmpcomm] - sent seq#: 383 msg: 0x400

BENGINE: [05/14/13 11:01:22] [0000] 05/14/13 11:01:21 [ndmp\ndmpcomm] - ndmp_process_messages: reply_expected:TRUE

BENGINE: [05/14/13 11:01:22] [0000] 05/14/13 11:01:21 [ndmp\ndmpcomm] - ndmp_recv_msg

BENGINE: [05/14/13 11:01:22] [0000] 05/14/13 11:01:21 [ndmp\ndmpcomm] - ndmp_readit: len:4000

BENGINE: [05/14/13 11:01:22] [0000] 05/14/13 11:01:21 [ndmp\ndmpcomm] - got expected reply msg: 0x400

BENGINE: [05/14/13 11:01:22] [0000] 05/14/13 11:01:21 [ndmp\ndmpcomm] - ndmp_process_messages: no more messages in stream buffer

BENGINE: [05/14/13 11:01:22] [0000] 05/14/13 11:01:21 [ndmp\ndmpcomm] - ndmpFreeMessage: message:0x400

BENGINE: [05/14/13 11:01:27] [0000] 05/14/13 11:01:26 [ndmp\ndmpcomm] - ndmpSendRequest: message:0x400

BENGINE: [05/14/13 11:01:27] [0000] 05/14/13 11:01:26 [ndmp\ndmpcomm] - ndmp_writeit: len:28

BENGINE: [05/14/13 11:01:27] [0000] 05/14/13 11:01:26 [ndmp\ndmpcomm] - sent seq#: 384 msg: 0x400

BENGINE: [05/14/13 11:01:27] [0000] 05/14/13 11:01:26 [ndmp\ndmpcomm] - ndmp_process_messages: reply_expected:TRUE

BENGINE: [05/14/13 11:01:27] [0000] 05/14/13 11:01:26 [ndmp\ndmpcomm] - ndmp_recv_msg

BENGINE: [05/14/13 11:01:27] [0000] 05/14/13 11:01:26 [ndmp\ndmpcomm] - ndmp_readit: len:4000

BENGINE: [05/14/13 11:01:27] [0000] 05/14/13 11:01:26 [ndmp\ndmpcomm] - got expected reply msg: 0x400

BENGINE: [05/14/13 11:01:27] [0000] 05/14/13 11:01:26 [ndmp\ndmpcomm] - ndmp_process_messages: no more messages in stream buffer

BENGINE: [05/14/13 11:01:27] [0000] 05/14/13 11:01:26 [ndmp\ndmpcomm] - ndmpFreeMessage: message:0x400

BENGINE: [05/14/13 11:01:32] [0000] 05/14/13 11:01:31 [ndmp\ndmpcomm] - ndmpSendRequest: message:0x400

BENGINE: [05/14/13 11:01:32] [0000] 05/14/13 11:01:31 [ndmp\ndmpcomm] - ndmp_writeit: len:28

BENGINE: [05/14/13 11:01:32] [0000] 05/14/13 11:01:31 [ndmp\ndmpcomm] - sent seq#: 385 msg: 0x400

BENGINE: [05/14/13 11:01:32] [0000] 05/14/13 11:01:31 [ndmp\ndmpcomm] - ndmp_process_messages: reply_expected:TRUE

BENGINE: [05/14/13 11:01:32] [0000] 05/14/13 11:01:31 [ndmp\ndmpcomm] - ndmp_recv_msg

BENGINE: [05/14/13 11:01:32] [0000] 05/14/13 11:01:31 [ndmp\ndmpcomm] - ndmp_readit: len:4000

BENGINE: [05/14/13 11:01:32] [0000] 05/14/13 11:01:31 [ndmp\ndmpcomm] - got expected reply msg: 0x400

BENGINE: [05/14/13 11:01:32] [0000] 05/14/13 11:01:31 [ndmp\ndmpcomm] - ndmp_process_messages: no more messages in stream buffer

BENGINE: [05/14/13 11:01:32] [0000] 05/14/13 11:01:31 [ndmp\ndmpcomm] - ndmpFreeMessage: message:0x400

BENGINE: [05/14/13 11:01:37] [0000] 05/14/13 11:01:36 [ndmp\ndmpcomm] - ndmpSendRequest: message:0x400

BENGINE: [05/14/13 11:01:37] [0000] 05/14/13 11:01:36 [ndmp\ndmpcomm] - ndmp_writeit: len:28

BENGINE: [05/14/13 11:01:37] [0000] 05/14/13 11:01:36 [ndmp\ndmpcomm] - sent seq#: 386 msg: 0x400

BENGINE: [05/14/13 11:01:37] [0000] 05/14/13 11:01:36 [ndmp\ndmpcomm] - ndmp_process_messages: reply_expected:TRUE

BENGINE: [05/14/13 11:01:37] [0000] 05/14/13 11:01:36 [ndmp\ndmpcomm] - ndmp_recv_msg

BENGINE: [05/14/13 11:01:37] [0000] 05/14/13 11:01:36 [ndmp\ndmpcomm] - ndmp_readit: len:4000

BENGINE: [05/14/13 11:01:37] [0000] 05/14/13 11:01:36 [ndmp\ndmpcomm] - got expected reply msg: 0x400

BENGINE: [05/14/13 11:01:37] [0000] 05/14/13 11:01:36 [ndmp\ndmpcomm] - ndmp_process_messages: no more messages in stream buffer

BENGINE: [05/14/13 11:01:37] [0000] 05/14/13 11:01:36 [ndmp\ndmpcomm] - ndmpFreeMessage: message:0x400

BENGINE: [05/14/13 11:01:42] [0000] 05/14/13 11:01:41 [ndmp\ndmpcomm] - ndmpSendRequest: message:0x400

BENGINE: [05/14/13 11:01:42] [0000] 05/14/13 11:01:41 [ndmp\ndmpcomm] - ndmp_writeit: len:28

BENGINE: [05/14/13 11:01:42] [0000] 05/14/13 11:01:41 [ndmp\ndmpcomm] - sent seq#: 387 msg: 0x400

BENGINE: [05/14/13 11:01:42] [0000] 05/14/13 11:01:41 [ndmp\ndmpcomm] - ndmp_process_messages: reply_expected:TRUE

BENGINE: [05/14/13 11:01:42] [0000] 05/14/13 11:01:41 [ndmp\ndmpcomm] - ndmp_recv_msg

BENGINE: [05/14/13 11:01:42] [0000] 05/14/13 11:01:41 [ndmp\ndmpcomm] - ndmp_readit: len:4000

BENGINE: [05/14/13 11:01:42] [0000] 05/14/13 11:01:41 [ndmp\ndmpcomm] - got expected reply msg: 0x400

BENGINE: [05/14/13 11:01:42] [0000] 05/14/13 11:01:41 [ndmp\ndmpcomm] - ndmp_process_messages: no more messages in stream buffer

BENGINE: [05/14/13 11:01:42] [0000] 05/14/13 11:01:41 [ndmp\ndmpcomm] - ndmpFreeMessage: message:0x400

systematic92 · ‎05-14-2013

Once the job is cancelled you can see the following in the properties:

Byte count             : 1,024 bytes
Rate                   : 0.00 MB/Min

Files                  : 0
Directories            : 0
Skipped files          : 0
Corrupt files          : 0
Files in use           : 0

Start time             : 14 May 2013 07:54:25
End time               : 14 May 2013 08:14:16

Media used             : ALQ837L5

VOX

CIFS Job stuck at 1024 bytes....